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Pre-face 


Establishing  the  -feasibility  o-f  using  Data  Envelopment 
and  Constrained  Facet  Analysis  Techniques  -for  Air  Force 
depot-maintenance  productivity  analysis  applications  is  an 
important  step  forward.  When  Air  Force  Logistics  Command 
implements  a  productivity  analysis  system  that  is  academically 
valid  and  useful  at  all  levels  of  management,  an  even  bigger 
stride  will  have  been  taken.  However,  a  system  large  enough 
to  tie  together  an  entire  command's  interests  must  begin  with 
a  series  of  small  steps.  Considerable  research  is  still 
needed,  not  just  with  DEA  and  CFA  applications,  but  with 
AFLC's  productivity  analysis  needs. 

In  performing  the  research  and  writing  the  thesis,  we 
wish  to  thank  the  following  people.  We  are  deeply  indebted  to 
Dennis  Campbell  and  Lt  Col  Charles  T.  Clark,  our  thesis 
advisor  and  reader,  for  their  immeasurable  assistance  in 
developing  our  research  approach  and  writing  this  thesis.  A 
special  thanks  goes  to  Barbara  Pruett  of  HQ  AFLC  and  Roger  P. 
Dwyer  of  Sacramento  Air  Logistics  Center  for  their  part  in 
leading  us  to  an  appropriate  sample  organization  and  in 
acquiring  the  necessary  data. 
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Abstr  ac t 


In  response  to  a  Headquarters  Air  Force  Logistics  Command 
thesis  proposal,  this  research  demonstrated  the  feasibility  of 
measuring  technical  productivity  in  a  depot  maintenance 
environment.  Linear  fractional  programming  techniques  called 
Data  Envelopment  Analysis  <DEA>  and  Constrained  Facet  Analysis 
(CFA)  were  used  to  show  that  the  productivity  of 
not-for-profit  maintenance  organizations  can  be  reliably 
measured  and  directly  supportive  of  management  dec i son  making. 
DEA/CFA  analyses  can  measure  multiple  inputs  and  outputs 
simultaneously  and  display  results  in  an  easily  understood 
format.  This  research  stresses  close  cooperation  between 
modelers  and  managers  in  selecting  input/output  variables  so 
that  information  derived  from  the  analysis  can  be  used 
effectively.  The  results  of  this  research  were  accepted  by 
using  managers  as  accurate,  simple  and  useful  in  their 
decision  making.  Additionally,  DEA/CFA  techniques  appear  to 
have  a  wide  range  of  potential  uses  in  many  Air  Force 
organizations  where  productivity,  capacity  and  resource 
allocation  analyses  are  needed. 


v  i  i 


Feasibility  of  Measuring  Technical  Productivity  Improvements 
in  Air  Force  Logistics  Command  Depot-Level  Maintenance 
using  the  Data  Envelopment  Analysis  <DEA>  and  the 
Constrained  Facet  Analysis  <CFA>  Models. 

I .  I n  troduc  t i on 

In  today's  world  o-f  rising  costs  and  scarce  resources, 
productivity  has  become  one  o-f  the  Air  Force's  most 
important  priorities.  Consequently,  in  the  summer  o-f  1983, 
senior  maintenance  managers  at  Headquarters  Air  Force 
Logistics  Command  <AFLC>  formed  a  Productivity  Measurement 
Working  Group  to  develop  a  total  factor  productivity  measure 
for  depot-level  maintenance.  AFLC  managers  hoped  a 
comparison  of  total  productivity  measurements  would  display 
the  most  efficient  organizations  and  unearth  some  new 
enhancement  techniques  to  increase  produc t i v i ty ,  reduce 
costs  and  increase  production. 

Statement  of  the  Problem 

Headquarters  AFLC  established  a  productivity 
enhancement  program  in  1980.  Most  AFLC  productivity 
enhancement  efforts  have  been  in  the  areas  of  "Methods 
Improvement  Programs"  and  "Quality  of  Working  Life 
Programs."  Overall,  twenty-nine  of  those  programs  are 
listed  in  the  29  April  1983  AFLC  Supplement  to  Air  Force 

1 


Regulation  <AFR)  25-3,  Air  Force  Productivity  Enhancement 


Program  <PEP)  <17:9-14).  These  programs  represented 


considerable  effort  and,  presumably,  productivity 


improvement.  However,  the  lack  of  effective  productivity 


measurements  made  quantifying  the  productivity  improvements 


speculative.  Quantifying  the  results  was  important  because 


productivity  improvement  efforts  invariably  required 


investment  costs  and  measurements  were  needed  to  show 


acceptable  return-on-investments  <22>. 


The  problem  was  stated  in  May  1983  by  Joseph  Gertge  of 


Headquarters  AFLC,  Directorate  of  Maintenance,  Financial 


Management  and  Productivity  Analysis  Division,  in  a  proposed 


Air  Force  Institute  of  Technology  (AFIT)  thesis  research 


topic  as: 


All  efforts  to  date,  to  measure  materials,  energy,  and 
capital  productivity  in  AFLC  have  been  less  than 
successful.  A  system  of  standards,  data  collection  and 
a  measurement  formula  must  be  designed  to  provide  a 
total  factor  (labor,  material,  energy,  capital) 
productivity  index.  Additionally,  a  separate 
measurement  of  productivity  should  be  developed  for 
each  input,  i.e.  material,  energy,  capital,  and  labor 
C 161  . 


The  problem  still  must  be  resolved, 


Object i vts 

The  objectives  of  this  thesis  are  to: 

1.  De-fine  productivity  for  AFLC  Depot-Level 
Maintenance. 

2.  Establish  criteria  to  select  input  and  output 
measurements  for  model  simulation. 

3.  Develop  the  relationship  between  selected  AFLC 
maintenance  production  inputs  and  outputs  using  the 
Data  Envelopment  Analysis  (DEA)  developed  by  Charnes, 
Cooper  and  Rhodes  <<$>  and  Constrained  Facet  Analysis 

< CFA)  developed  by  Bessent,  Bessent,  Clark  and  Elam 
<  5)  . 

4.  Evaluate  the  DEA  and  CFA  models  and  show  their 
advantages  to  other  measurement  techniques  using  data 
provided  by  Hq  AFLC. 

5.  Suggest  appropriate  Air  Force  applications  of  the 
DEA  and  CFA  models  based  on  this  research. 
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Scope 


The  development  of  increased  productivity  concerns  is 
presented  in  a  brief  history  o-f  the  productivity  discipline 
development  o-f  key  definitions,  and  a  description  of  the 
current  Department  of  Defense  and  U.S.  Air  Force 
productivity  programs.  The  reader  should  note  that  Appendi 
A  contains  a  glossary  that  defines  terms  that  are  specific 
to  this  research.  This  thesis  examines  two  specific 
measurement  models:  the  DEA  model  and  the  CFA  model.  The 
DEA  and  CFA  models  evaluate  the  data  provided  by  Hq  AFLC. 
The  results  of  the  models'  simulation  are  analyzed  by  the 
authors  and  examined  by  managers.  However,  the  following 
assumptions  are  made: 

1.  Data  provided  by  Hq  AFLC  is  valid,  accurate  and 
based  on  empirical  evidence. 

2.  The  DEA  and  CFA  models  are  theoretically  valid  as 
productivity  measurement  techniques.  Support  of  this 
assumption  can  be  found  in  research  by  Charnes,  Cooper 
and  Rhodes  (6;  7)  and  Bessent,  Bessent,  and  Clark  (4) 


and  Clark  < 8) . 


1 1 .  Literature  Review 


Background 

In  the  20th  century,  productivity  has  gained  importance 
•from  a  discussion  topic  to  a  true  field  of  inquiry.  Many  of 
America's  best  economic  minds  devote  considerable  time  to 
analyzing  ways  to  improve  productivity  because  of  the 
motivation  of  expected  benefits  from  such  improvements. 

Firms  know  the  benefits  derived  from  improving  productivity 
in  the  long  run  add  up  to  continued  existence  of  the  firm. 
Much  is  made  in  today's  media  of  the  differences  in 
productivity  between  American  industry  and  industries  in 
countries  such  as  Japan  and  West  Germany. 

This  preoccupation  with  productivity  is  mirrored  in  the 
military  community.  The  Department  of  Defense  <D0D>  has  a 
productivity  program  and  dictates  that  each  major  function 
of  the  department  have  one  also.  Why? 

The  answer  may  be  found  by  looking  at  incentives.  The 
not-for-profit  organization,  such  as  DOD,  is  of  value  to 
society  as  long  as  its  products  or  services  can  be  provided 
at  an  acceptable  cost  (economic  or  noneconomic).  When  this 
situation  prevails,  the  organization  is  generally  thought  of 
as  productive. 

Before  World  War  II  productivity  measures  were 
primarily  focused  on  labor  efficiency.  It  was  not  until 
1942  that  the  first  empirical  measure  of  total  productivity 


was  attempted.  The  concept  of  Total  Factor  Productivity 
<TFP>  was  -first  advanced  in  popularity  in  economic  circles 
by  John  Kendrick  at  a  1951  National  Income  and  Wealth 
Con-ference  <18:3).  According  to  Kendrick,  the  expansion  o-f 
productivity  measurement,  because  o-f  growing  recognition  of 
its  importance,  has  resulted  in  a  distinct  new  field  of 
inquiry.  TFP  and  intense  theoretical  thought  on  the  subject 
have  parallel  developments,  both  beginning  about  1950 
<18:3-4) . 

Americans  pioneered  development  of  the  productivity 
field  but  the  U.S.  as  a  nation  was  slower  than  other  nations 
to  capitalize  on  the  potential  advancements.  Japan,  because 
of  rapid  national  rebuilding  and  with  the  encouragement  of 
U.S.  foreign  aid,  used  productivity  measurements  to  keep  its 
postwar  reconstruction  efforts  on  track  from  the  beginning. 
This  can  be  seen  in  the  development  of  national  productivity 
centers  Specialized  institutional  support  for  measuring, 
analyzing  and  promoting  produc t i v i ty ) .  The  Japan 
Productivity  Center  was  established  in  1955  and  the  Asian 
Productivity  Organization,  a  seven-coun tr y  effort,  was 
established  a  few  years  later  in  the  early  1960's 
<19:22-23) . 

Not  until  President  Nixon  established  the  U.S.  National 
Commission  on  Productivity  by  executive  order  in  1970,  did 
the  U.S.  itself  have  such  a  specialized  productivity  agency. 
The  executive  order  came  as  a  result  of  a  national 
productivity  slump  in  the  late  1960's.  Since  1970  increased 


national  awareness  of  the  importance  of  productivity 
improvement  has  accelerated  the  U.S.  to  a  level  more 
favorably  comparable  with  other  industrialized  nations 
<19:24) . 


Traditional  Definitions 

Examination  of  productivity  must  begin  with  a 
definition  of  the  concept.  Lt  Col  Russell  Lloyd,  head  of 
the  AFIT  School  of  Systems  and  Logistics  Organ i zat i onal 
Sciences  Department,  described  productivity  as  "a  concept 
that  eludes  easy  definition  1201.'  This  is  illustrated  by 
the  many  articles,  books  and  papers  on  the  subject.  A  few 
points,  however,  are  repeated  in  most  discussions  of 
product i v i ty .  Terms  such  as  ef f i c i ency ,  effect i veness , 
t ime 1  i ness,  qua!  i ty ,  object i ves ,  and  ratios  are  integral  to 
an  understanding  of  the  term  produc  t i v i ty . 

According  to  the  American  Productivity  Center  (APC) 
<23:4),  the  definition  of  productivity  comes  from  the  profit 
equation  where: 


Profitability  =  Productivity  x  Price  Recovery  = 
Output  Quantities  X  Prices 


Input  Quantities  X  Unit  Costs 


The  APC  says  productivity  is  the  output  quantities  divided 
by  input  quantities  portion  of  Eq  <1>  whereas  price 
recovery  is  the  prices  divided  by  costs.  The  APC  believes 


there  are  two  ways  a  firm  can  increase  profit:  *it  can 


produce  more  output  per  unit  of  input  consumed  or  it  can 
raise  its  prices  -faster  than  its  suppliers  are  raising 
theirs  C23,43."  However,  this  explanation  ignores  the 
possibility  that  a  -firm  could  decrease  costs  per  unit  input 
by  increasing  their  produc  t  i  v  i  ty .  There-fore,  productivity 
could  exclude  output  prices  and  instead  be: 

Productivity  =  _ Output  Quant  i  t  i  es _ 

Input  Quantities  X  Unit  Costs  (2) 

John  W.  Kendrick,  in  his  book,  Understanding 
Product i v i ty ,  says:  "Productivity  is  the  relationship 
between  output  o-f  goods  and  services  and  the  input  o-f  basic 

resources  -  labor,  capital  goods,  and  natural  resources 

[19:1].*  Kendrick  -further  emphasizes  that  increased 
productivity  is  the  chie-f  means  available  to  humanity  to 
raise  itself  out  o-f  poverty  to  relative  affluence  (19:1). 

The  idea  of  a  relationship  between  inputs  and  outputs  to  a 
process  is  a  central  theme  in  studying  productivity.  Adam, 
Hershauer  and  Ruch,  in  their  book  Productivity  and  Quality, 
define  productivity  generically:  "Productivity  is  a  systemic 
concept  concerning  the  conversion  of  inputs  to  outputs  by 
the  system  under  consideration  [1:103."  Somewhat 
differently,  Paul  Mali  defines  productivity  as  "reaching  the 
highest  level  of  performance  with  the  least  expenditure  of 
resources  [21:43. "  Mali  attempts  to  incorporate  all  three 


ideas  with  this  index  ratio  (21:7): 


Output 

Perf ormance 

Produc  t i v i ty  = 

Obtained  = 

Achieved  = 

Effect i veness 

I  ndex 

Input 

Resources 

Efficiency 

Expended 

Consumed 

( 3> 

Common  to  all  the  definitions  is  the  relationship  of 
outputs  to  inputs.  However,  in  Eq  (3)  Mali  implies,  but 
never  explicitly  states,  a  quality  judgment  when  he 
transforms  "output  obtained"  into  "performance  achieved." 
Therefore,  his  transition  to  “effectiveness*  over 
"efficiency"  is  hard  to  follow.  The  authors  believe  Mali's 
"output  obtained"  over  "input  expended"  should  result  in  an 
index  of  efficiency  only  and  effectiveness  should  include 
other  qualitative  variables  such  as  outputs  not  meeting 
engineering  specifications,  failing  to  perform,  or  delivered 
1  ate . 

Common  productivity  measures  that  are  derived  from 
ratios  of  outputs  to  inputs  include  the  national 
productivity  measures  from  the  Departments  of  Labor, 

Commerce  and  Agriculture  and  are  expressed  as  indexes.  For 
a  firm,  outputs  could  be  goods  produced  or  services 
performed.  Likewise,  inputs  could  be  labor  employed, 
equipment  used,  or  raw  materials  consumed.  Outputs  obtained 
over  inputs  expended  are  usually  formed  as  index  numbers, 
such  as  shirts  produced  per  hour  of  labor.  Usually,  the 
index  numbers  must  be  compared  to  a  base  period.  For 
example,  it  would  not  be  practical  to  compare  a  firm's 
output  prof i t  over  labor  and  machinery  costs  from  one  year 


to  the  next  without  adjustments  -for  inflation  or  the  time 
value  of  money.  Consequently,  a  base  year  or  period  should 
be  established  to  adjust  each  year's  index  numbers. 

From  these  definitions  of  pr oduc t i v i ty ,  one  could  think 
the  study  of  productivity  is  concerned  only  with  quantities 
of  outputs  per  quantities  of  inputs.  This  may  be  the  case 
if  one  uses  the  productivity  measures  primarily  to  improve 
efficiency  or  conserve  resources.  However,  other  dimensions 
such  as  quality  and  timeliness  of  outputs  may  apply.  Adam, 
Hershauer  and  Ruch  say:  “There  is  no  economic  value  in 
increased  output  levels  if  the  increase  is  offset  by  lower 
qual i ty  11:123.“ 

The  concept  of  conserving  resources  is  usually  included 
in  the  discussions  of  efficiency.  Quality  and  timeliness  of 
the  outputs  are  included  in  the  concept  of  effectiveness. 
Including  effectiveness  measures  in  an  analysis  then 
requires  a  much  1 arger  data  base.  For  this  research  effort, 
efficiency  is  defined  as  the  ratio  of  the  work  done  by  an 
organism  or  machine  to  the  energy  supplied  in  the  form  of 
food  or  fuel.  Effectiveness,  on  the  other  hand,  is  regarded 
as  the  same  ratio  but  considers  only  the  “useful"  work  done. 
Useful  here  refers  to  work  that  is  of  sufficient  quality  and 
done  in  acceptable  time  frames.  Therefore,  for  the  purpose 
of  this  research,  productivity  will  be  a  measure  of  “useful" 
work  done  in  the  most  efficient  manner  with  emphasis  towards 
measuring  the  technical  efficiency  of  the  AFLC  maintenance 
function  chosen  for  the  modeling  effort. 


The  variety  of  productivity  definitions  in  non-military 

sectors  is  mirrored  in  the  mi  1  i tary  community.  The 

Department  of  Defense  (DOD)  productivity  directive  is  DOD 

Directive  5010.31,  POD  Productivity  Program,  April  1979  and, 

together  with  DOD  Instruction  5010.34,  Produc t i v i ty 

Enhancement  and  Evaluation  -  Operating  Guidelines  and 

Reporting  Instructions,  implements  the  DOD  productivity 

program.  In  1975,  DOD  directed  each  military  department  to 

establish  a  productivity  program  and  designate  an  office 

responsible  for  planning,  coordinating  and  representing  the 

department  on  productivity  matters  (12).  The  Air  Force's 

productivity  regulation  is  AFR  25-3,  Air  Force  Productivity 

Enhancement  Program  (PEP),  dated  25  February  1982. 

The  DOD  productivity  program  language  emphasizes  a 

technical,  labor  oriented  view  of  produc t i v i ty .  For 

example,  DOD  Directive  5010.31  states: 

The  DOD  Productivity  Program  is  a  labor  oriented 
program.  Therefore,  the  primary  basis  for  productivity 
assessment  will  be  labor  productivity  measurement.  .  . 

.  Where  adequate  cost  information  is  available,  total 
factor  unit  cost  measures  may  be  used  in  addition  to 
labor  based  productivity  measures  £12:21. 


Thus,  economic  as  well  as  the  partial  technical  measures  of 

labor  productivity  are  encouraged.  Slightly  different,  the 

Air  Force  formal  definition  of  productivity  is: 

The  measure  of  an  organization's  or  function's 
performance.  The  efficiency  or  effectiveness  with 
which  resources  (inputs)  are  used  to  accomplish  a  given 
mission  (output)  [11:93. 

A  further  look  at  DOD  definitions  shows  effectiveness 
measurement  is  a:  ‘Comparison  of  current  performance  against 
pre-established  mission  objectives  (goals)  [13:103."  The 
Air  Force  believes  effectiveness  measurement  "Compares 
actual  results  (output)  to  some  pre-established 
organizational  or  functional  objective  or  goal  C12:93." 

Here  both  DOD  and  Air  Force  definitions  agree. 

However,  consider  the  definitions  of  efficiency 
measurement.  The  DOD  concept  of  efficiency  measurement  is: 
■Comparison  of  current  performance  against  either  a 
pre-established  standard  or  actual  performance  of  a  prior 
period  C13:103."  The  Air  Force  states  efficiency 
measurement  is:  "The  determination  and  comparison  of  the 
change  in  an  organization's  or  function's  output-input 
relationships  for  two  or  more  periods  of  time  [11:93." 

These  definitions  mean  the  same  thing;  however,  both  fail  to 
recognize  that  efficiency  can  be  both  a  comparison  of 
several  similar  units  at  a  point  in  time  or  the  same  unit 
compared  to  itself  over  time. 


John  Kendrick,  in  Understanding  Produc t i v i ty , 

rein-forces  the  authors'1  observations  of  the  DOD  and  AF 

de-finitions  with  these  comments: 

Others  interpret  the  term  (productivity)  as  always 
signifying  the  familiar  ou tpu t-per-man-hour  ratio, 
whereas  productivity  may  refer  to  the  relationship  of 
output  to  any  or  all  of  the  associated  inputs,  nonhuman 
as  well  as  human  [19:12]. 

He  further  states  that  output  increases  may  be  a  result  of 
substituting  other  factors  such  as  capital  or  some  nonlabor 
inputs  <19:13).  Lastly,  Kendrick  makes  another  point 
relevant  to  an  examination  of  DOD  and  Air  Force  productivity 
with: 

Occas i onal 1 y ,  work  measures  are  confused  with 
productivity  measures.  But  work  measures  relate  actual 
output  to  a  norm,  or  standard.  They  thus  measure 
levels  and  changes  in  efficiency  under  a  given 
technology.  They  (work  measures)  are  not  measures  of 
productivity,  which  reflect  changes  in  technology  and 
other  factors  in  addition  to  changes  in  labor 
efficiency  as  such.  Finally,  it  must  be  noted  that  the 
level  of  a  productivity  ratio  for  any  one  period  is  not 
significant.  Significance  is  derived  from  comparisons 
of  the  ratios  for  particular  units,  industries,  or 
sectors  over  time  (rate  of  change);...  [19:13]. 

This  analysis  of  military  definitions  of  productivity 

suggests  a  broader  perspective  that  both  transcends  a  labor 

oriented  view  and  a  preoccupation  with  work  measurements.  A 

measurement  technique  capable  of  capturing  all  the  factors 

suggested  by  Kendrick  has  yet  to  be  developed.  The  next 

section  analyzes  several  measurement  techniques. 


Measurements  Analyzed 


Productivity  may  be  measured  in  many  ways.  A  manager 


may  choose  partial  or  total  ratios  and  employ  statistical 


analysis,  linear  programming,  heuristics  or  other  techniques 


to  analyze  his  -firm.  The  goal  should  be  to  develop 


n-formation  that  aids  management  decision  making.  The 


purpose  o-f  this  section  is  to  discuss  the  concepts  of 


partial  ratios,  total  measurement  ratios  and  the  DEA  and  CFA 


models  and  compare  their  advantages  and  disadvantages. 


Productivity  analysis  involves  measurement  and 


evaluation  and  presupposes  standards  of  performance 


(profitability  and  cost  of  production).  While  productivity 


analysis  looks  at  the  technical  process  of  the  firm  (the 


conversion  of  inputs  into  outputs  via  a  process),  the 


management  decisions  that  result  will  invariably  affect 


prof i tabi 1 i ty  or  costs. 


According  to  Kendricks  "productivity  analysis  draws  on 


many  of  the  tools  and  concepts  of  microeconomics  and 


macroeconomics,  as  well  as  on  the  institutional  and 


analytical  content  [18:26]."  Productivity  analysis  of  a 


firm  in  the  past  has  begun  with  the  production  function 


where  quantity  <Q)  is  a  function  of  labor  <L)  and  capital 


<C)  or  stated  as  Q  =  f(L,C).  Productivity  might  also  be 


expressed  as  a  ratio  of  output  quantity  over  labor  or 


capital  (inputs)  for  each  firm.  Each  firm  is  then  compared 


to  determine  the  most  efficient  firm.  Additionally, 


productivity  analysis  might  also  compare  a  firm  against 
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itself  over  a  period  of  time. 

Two  factors  have  inhibited  the  practical  use  of 
Kendrick's  concept.  One,  the  “real“  production  function  has 
always  been  unknown  and  could  only  be  assumed.  Two,  firms 
could  only  be  compared  directly  if  their  outputs  were 
si  mi  1 ar  . 

Partial  Ratios.  An  easy  productivity  measurement 
to  derive  and  understand  is  a  partial  productivity  index  of 
one  output  obtained  over  one  input  expended.  An  example  of 
its  usefulness  can  be  shown  by  a  comparison  of  two  small 
firms,  A  and  B.  Firm  A  has  five  workers  making  ten  shirts 
per  hour,  while  Firm  B  has  ten  workers  making  20  shirts  per 
hour.  Ulhich  firm  is  more  productive?  Using  the 
productivity  index  formula,  the  ratio  becomes  the  following 
where  productivity  equals: 


Outputs 

Inputs 


F  i  rm  A 

10  Shirts  = 
5  Workers 


Firm  B 

20  Shirts  » 
10  Workers 


Index 

2  Shirts _ 

Workers/Hour  <4> 


Both  firms  are  equally  productive  in  Eq  (4),  even  though  one 
produces  more  shirts  than  the  other.  If  Firm  B  loses  two 
workers  and  still  produces  20  shirts  per  hour,  its 
productivity  index  would  change  to  20  shirts/8  workers  or 
2.5  sh i r t s/worker/hour .  This  suggests  Firm  B  would  then  be 
more  productive  than  Firm  A.  Furthermore,  by  maintaining 
the  same  production  rate  after  losing  two  workers,  Firm  B 
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has  shown  it  possessed  a  surplus  o-f  workers  in  the  -first 
place  or  it  changed  to  a  more  productive  process. 

To  remain  competitive,  the  manager  o-f  Firm  A  might  wish 
to  explore  what  caused  Firm  B  to  be  more  e-f-ficient  so  Firm  A 
could  bene-fit.  There  could  be  several  reasons  -for  the 
difference,  such  as  room  size,  environmental  conditions,  or 
Firm  B  introduced  a  new  technology.  Also,  the  number  and 
type  o-f  machines  might  be  a  factor.  Therefore,  a  more 
accurate  productivity  measure  would  include  all  inputs  and 
facets  of  production. 

Total  Factor  Ratios.  A  disadvantage  of  using  only 
partial  measurements  is  that  a  manager's  interest  could  be 
parochial  allowing  one  area  to  improve  and  another  to 
decline.  The  overall  impact  could  be  less  than  desired. 
Partial  productivity  measurements  may  give  the  manager  some 
information  on  the  effects  of  individual  enhancements  for 
parts  of  the  firm,  but  most  firms  have  many  inputs  and 
outputs.  A  total  productivity  ratio  of  all  outputs  over  all 
inputs  that  evaluates  the  whole  firm  is  needed.  An  example 
of  a  total  ratio  is  this  one  by  Mali  <21:91); 

Total  Factor  =  _  A1  1  Ou  tpu  ts _ 

Ratio  Labor  +  Capital  +  Resources  +  Others  (5) 

While  an  advantage  of  a  total  factor  ratio  is  that  it 


considers  all  outputs  and  inputs  of  a  firm,  a  disadvantage 
is  that  each  element  of  the  inputs  may  influence  the  outputs 


in  different  end  unapparent  proportions.  For  example, 
labor  may  affect  the  outputs  more  than  capital,  but  this 
effect  may  not  be  recognizable  in  Mali's  total  factor  ratio. 
Cowling  and  Stevenson  explain  another  disadvantage  as  “the 
difficulties  of  disentangling  technical  change  from  the 
effects  of  scale  economies  and  input  substitution  [10:7]." 

One  problem  common  to  many  total  productivity 
measurement  models  is  they  do  not  aid  management  in  their 
daily  decision  making  process.  Either  the  formats  used  in 
presenting  the  information  are  too  detailed,  making  useful 
facts  difficult  to  differentiate  from  irrelevant  ones,  or 
the  reported  results  are  so  simplified  only  the  most  macro 
decisions  are  supported. 

According  to  Barbara  Pruett  (22),  Chief  of  the 
Productivity  and  Evaluation  Division  at  HQ  AFLC,  this 
failure  of  productivity  measurement  models  to  support 
management  decisions  has  frustrated  HQ  AFLC  maintenance 
managers  searching  for  an  effective  productivity  measurement 
tool.  Popular  techniques  such  as  the  Navy  Matrix  Model,  the 
American  Productivity  Center  (APC)  Model,  and  the  Project  1? 
Model,  developed  at  the  AFLC  Ogden  Air  Logistics  Center 
Research  Lab,  Ogden,  Utah,  were  considered  and  discarded  by 
the  HQ  AFLC  Productivity  Measurement  Working  Group  (22) 
because  of  their  cumbersome  use  and  failure  to  provide 
relevant  data  for  decision  making. 


Data  Envelopment  Analysis  and  Constrained  Facet 


Anal  ys i  s .  The  Data  Envelopment  Analysis  technique  was 
developed  by  Charnes,  Cooper  and  Rhodes  -for  measuring 
ef  f  i  c  i  enc  i  es  of  organizations  <6>.  Constrained  Facet 
Analysis  is  an  extension  o-f  the  DEA  model  developed  by 
Bessent,  Bessent,  Clark  and  Elam  <5>.  A  detailed 
explanation  o-f  both  models  is  -found  in  chapter  3;  however, 
important  here  is  the  -fact  that  both  measure  multiple  inputs 
to  multiple  outputs  simultaneously.  According  to  Lt  Col 
Charles  Clark  o-f  the  Air  Force  Institute  o-f  Technology 
<8:?0-?4),  usefulness  of  DEA  for  efficiency  evaluations  has 
been  demonstrated  in  the  health  care  field,  the  public 
education  field,  the  North  Carolina  judicial  system,  and  the 
Navy  recruiting  field.  All  these  fields  are  not-foi — profit 
and  have  measurement  difficulties  similar  to  AFLC  depot 
level  maintenance.  A  major  problem,  when  attempting 
measurements  in  not-for-profit  organizations,  occurs  when 
outputs  are  in  the  form  of  "benefits"  which  are  not  as 
easily  quantified  as  the  outputs  of  an  assembly  line.  The 
DEA  and  CFA  models  were  selected  for  this  research  because 
they  were  developed  specifically  to  satisfy  the  need  for 
productivity  measurement  of  not-f or-prof i t  organizations. 
Some  of  DEA  and  CFA  advantages  are: 

1.  They  have  proven  useful  in  large,  complex 

organ i zat i ons . 

2.  They  are  capable  of  taking  into  account  multiple 

inputs  and  multiple  outputs  simultaneously. 


3.  In-formation  produced  can  directly  support  decision 
making  at  many  management  levels. 

4.  They  are  adaptable  to  networked  computer  operations 
connected  with  many  geogr aph i cal  1 y-separated  centers. 
The  DEA  and  CFA  models  are  largely  untried  in  the  Air 

Force  environment.  Because  DEA  and  CFA  have  proven  to  be 
use-ful  ,  state  o-f  the  art  techniques  in  other  not— f  or-pr  o-f  i  t 


organizations,  there  may  be  many  worthwhile  ways  o-f  applying 
these  techniques  in  AFLC  and  other  Air  Force  organizations. 


Summary 


The  U.S.  has  lagged  behind  other  industrialized  nations 
in  productivity  enhancement,  particularly  in  the  late  1960s. 
The  Defense  community  has  also  been  slow  to  develop  cohesive 
productivity  programs.  AFLC,  an  early  leader  in  Air  Force 
enhancement  efforts,  has  been  hampered  by  a  less  than 
satisfactory  productivity  measurement  capability. 

Productivity  is  traditionally  defined  as  some  function 
of  effectiveness  and  efficiency.  For  purposes  of  this 
research,  effectiveness  is  combining  all  inputs  into  useful 
outputs.  However,  outputs  not  meeting  organizational 
objectives  for  quantity,  quality  or  timeliness  are  not 
considered  useful.  Efficiency  is  the  conservation  of  input 
resources  while  producing  a  maximum  number  of  outputs.  The 
authors  intend  to  measure  technical  efficiency  within  an 
AFLC  maintenance  area  and  assume  outputs  meet  organizational 
effectiveness  criteria. 


1? 


DOD  and  Air  Force  regulations  emphasize  the  technical, 
labor  oriented  view  of  productivity  <i.e.,  ou  tpu  t-per-man 
hour).  This  labor  oriented  view  and  many  other  popular 
productivity  measurements  before  the  DEA  and  CFA  techniques 
were  a  collection  o-f  simple  output  to  input  ratios  called 
partial  ratios.  Partial  ratios  are  easy  to  derive  and 
understand  but  limit  the  analysis  to  only  one  area  o-f  a 
-firm.  However,  a  total  -factor  ratio  evaluates  the  whole 
-firm  by  considering  all  outputs  and  inputs,  but  may  not 
account  -for  the  interactivity  o-f  inputs  and  outputs  measured 
s i mu  1 taneousl y . 

The  DEA  and  CFA  techniques  have  demonstrated  their 
use-fulness  in  e-f-ficiency  evaluation  in  many  not— f or-prof  i  t 
organizations.  Their  advantages  over  partial  and  total 
■factor  ratios  are  DEA  and  CFA  measure  multiple  inputs  and 
multiple  outputs  simultaneously,  account  for  the 
interactions  of  the  variables  and  produce  information  that 
directly  supports  management  decision  making.  The  following 
chapter  presents  a  detailed  explanation  of  the  DEA  and  CFA 
models  and  their  charac ter i st i cs. 


I  n  tr oduc  t  i  on 


Chapter  I  includes  a  list  of  the  five  research 
objectives  for  this  thesis.  The  first  objective,  (1)  to 
define  productivity  for  AFLC  depot-level  maintenance,  was 
met  with  the  1 i terature  review  in  Chapter  II.  This  chapter 
accomplishes  objectives  two  and  three  which  are:  <2>  to 
establish  criteria  to  select  input  and  output  measurements, 
and  (3)  to  develop  the  relationship  between  selected  inputs 
and  outputs  using  DEA  and  CFA.  The  groundwork  for  objective 
four,  <  4)  to  evaluate  the  DEA  and  CFA  models  using  AFLC 
data,  begins  in  Chapter  IV  and  is  concluded  in  Chapter  V. 
Objective  five,  <5)  to  suggest  appropriate  Air  Force  DEA  and 
CFA  applications,  is  met  in  Chapter  VI. 

Development  of  the  methodology  starts  with  an 
explanation  of  how  DEA  and  CFA  models  work  and  is  followed 
by  a  description  of  the  data  selection  criteria.  Next,  the 
data  source  and  the  process  of  extracting  the  inputs  and 
outputs  used  in  the  model  are  presented  along  with  data 
limitations.  This  is  followed  by  a  discussion  of  the 
modeling  exercise  that  details  the  various  combinations  of 
inputs  and  outputs  that  are  compared  and  analyzed.  Finally, 
the  types  of  information  the  model  should  produce  are 


The  DEA  model  is  expressed  in  the  -following 


mathematical  -form  according  to  A.  Bessent  and  E.  Bessent  o-f 
University  o-f  Texas  <3,59>: 


Objective  Function 
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where : 


measurement  o-f  rth  valued  output  -for 
decision  making  unit  (DMU)  j 
measurement  of  i th  input  for  DMU  j 
weight  for  output  r  to  be  calculated  from 
the  analysis 

weight  for  input  i  to  be  calculated  from 
the  analysis  (6) 


A  decision  making  unit  (DMU)  is  an  organizational 
element  being  analyzed.  For  instance,  if  an  analysis 
compares  35  warehouses,  each  warehouse  would  be  a  DMU.  An 
alternate  method  would  be  to  compare  the  same  warehouse  to 
itself  over  time  by  making  periodic  observations  where  each 
observation  is  treated  as  a  DMU.  DMUs  have  similar  observed 
input  and  output  measures  represented  by  y  and  x  values  in 
the  equation.  The  values  u  and  v  are  unbiased  weights  (also 
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refer red  to  as  multipliers  in  some  references)  derived  from 
the  model  calculations. 

It  is  important  to  understand  the  specific  difference 
between  the  terms  efficient  and  inefficient.  Charnes, 

Cooper  and  Rhodes  (6:669)  define  DMU  efficiency  as: 

i.  Output  Orientation:  A  DMU  is  not  efficient  if  it 
is  possible  to  augment  any  output  without  increasing 
any  input  and  without  decreasing  any  other  output. 

ii.  Input  Orientation:  A  DMU  is  not  efficient  if  it 
is  possible  to  decrease  any  input  without  augmenting 
any  other  input  and  without  decreasing  any  output. 

These  definitions  are  accepted  as  consistent  with  the 

definition  of  efficiency  as  stated  in  the  summary  of  Chapter 

II  and  operationalize  efficiency  for  purposes  of  this 

research . 

According  to  Bessent  and  Bessent,  DMU  efficiency 
analysis  starts  when  "all  units  are  compared  in  order  to 
locate  the  best  ones  in  the  set  and  to  use  these  as  the 
criterion  of  efficiency  C3:603.*  The  following  graph  of  a 
single  output,  two  input  case  illustrates  how  DEA  analysis 
works.  This  example  was  first  presented  by  Clark  in  his 


dissertation  (8:30). 


Figure  1.  How  DEA  and  CFA  Work 

Figure  1  represents  five  DMUs  with  different  mixes  of 
input  quantities  producing  the  same  output  quantity.  The 
output  quantity  for  each  is  displayed  as  identical  because 
the  single  output  DEA  solution  is  equivalent  to  scaling  all 
DMU  outputs  to  a  single  quantity  and  propor t i onal 1 y  reducing 
all  DMU  inputs.  A  ■piece-wise  linear  frontier*  is  formed  by 
connecting  points  A,  B  and  C  (DMUs  closest  to  the  origin). 


This  curve  represents  the  most  efficient  DMUs  and  is  called 
the  relative  efficiency  -frontier.  Each  DMU  on  the  -frontier 
produces  the  same  output  with  fewer  quantities  o-f  inputs  xl 
and  x2  than  any  DMU  not  on  the  frontier.  DMUs  on  the 
efficiency  frontier  are  considered  by  DEA  to  be  100 V. 
efficient.  However,  DEA  100K  efficiency  is  not  absolute  but 
is  the  rating  given  to  the  best  of  the  observed  DMUs  with  no 
assumption  of  an  ideal  production  function. 

The  model  next  compares  the  inefficient  DMU  represented 
by  point  D  <4, 4)  to  the  segment  of  the  frontier  between  A 
and  B.  This  is  done  by  extending  a  ray  from  the  origin 
<0,0)  to  point  D.  The  unit's  efficiency  is  a  ratio  of  the 
length  of  the  line  segment  from  the  origin  to  the 
intersection  of  the  frontier  segment  <A  to  B>  divided  by  the 
entire  length  of  the  ray  from  the  origin  to  D.  In  this 
example  the  efficiency  ratio  is  6T/..  This  also  illustrates 
the  'envelopment"  charac ter i st i c  of  the  model  where  point  D 
is  compared  to  the  emp i r i cal  1 y-der i ved  frontier  segment 
between  A  and  B  because  the  line  from  the  origin  to  D  passes 
through  that  portion  of  the  frontier. 

The  efficiency  rating  of  point  D  is  derived  wi thout 
comparison  to  any  other  points  but  A  and  B,  illustrating 
another  important  aspect  of  DEA  analysis.  Inefficient  DMUs 
are  directly  compared  only  to  DMUs  on  the  efficiency 
frontier  which  have  similar  mixes  of  inputs  and  outputs. 
According  to  Barbara  Pruett,  overcoming  the  tendency  to 
compare  dissimilar  activities  would  be  an  advantage  of  using 


DEA  productivity  analysis  in  AFLC  management  decision  making 
(22)  . 

Constrained  Facet  Analysis.  A.  Bessent  and  others  <5> 
extended  the  use  of  DEA  analysis  with  Constrained  Facet 
Analysis  <CFA> .  This  technique  explores  the  efficiency  of 
points  like  E  <6,1>  in  Figure  1,  which  lies  outside  the 
frontier  envelope.  Referring  to  Figure  1,  CFA  computes  a 
lower  bound  of  efficiency  by  creating  a  downward  sloping 
extension  of  the  frontier  from  point  C  to  the  x2-ax i s  and  an 
upper  bound  of  efficiency  by  creating  an  horizontal  frontier 
extension  parallel  to  the  x2-axis  from  point  C.  The 
efficiency  of  point  E  is  then  computed  like  point  D,  except 
that  two  efficiency  ratings  are  derived  from  the  two 
imaginary  frontiers.  True  efficiency  for  point  E  is  assumed 
to  be  bounded  by  the  two  resulting  efficiency  ratings.  In 
Figure  1,  the  efficiency  boundaries  of  point  E  are  100% 
efficient  and  71%  inefficient.  In  this  way,  all  DMUs  can  be 
evaluated,  although  for  points  like  E  a  range  of  efficiency 
is  provided. 

Another  aspect  of  CFA  is  the  in-depth  analysis  of 
neighborhood  portions  of  the  frontier.  Several  DMUs 
clustered  together  in  an  area  of  a  graph  (such  as  points  A, 

B  and  D  in  Figure  1)  are  considered  a  “neighborhood" 
according  to  Clark  (?).  Specific  actions  that  would  move  an 
inefficient  DMU  to  the  efficiency  frontier  can  be  explored 
by  examining  the  characteristics  of  the  DMUs  in  the 
neighborhood.  Since  points  A  and  B  are  considered  efficient 


and  in  point  D's  neighborhood,  point  0  should  be  able  to 
improve  to  an  efficiency  level  comparable  to  A  and  B. 

Summary  of  PEA  and  CFA  Characteristics.  DEA  and  CFA 
productivity  analyses  have  many  char ac ter i st i cs  important  to 
organization  managers  <?>.  Some  are: 

1.  A  frontier  of  efficiency  is  built  based  on 
empirical  data  instead  of  assuming  an  ideal  production 
function  (such  as  an  economic  isoquant). 

2.  All  aspects  of  the  organization  can  be  measured 
simultaneously,  capturing  trade-offs  and  interactions 
between  inputs  and  outputs. 

3.  All  DMUs  are  rated  efficient  or  inefficient.  If 
the  DliU  has  a  unique  input/output  mix  and  is  identified 
as  an  outlier,  it  is  still  rated  with  estimates  of 
efficiency  boundaries. 

4.  In  addition  to  rating  all  DMUs,  individual  DMU 
inputs  and  outputs  are  rated  for  their  contribution  to 
a  DMUs  efficiency  rating.  This  helps  pinpoint  and 
prioritize  corrective  actions  for  inefficient  DMUs. 

5.  Value  judgments  or  a  priori  weights  are  not 
assigned  to  inputs  or  outputs  for  DEA  or  CFA 
calculations.  Weights  or  multipliers  appearing  in  the 
analysis  results  are  produced  by  the  models. 

6.  DMUs  rated  inefficient  by  DEA  or  CFA  are  assigned 
the  highest  possible  efficiency  rating.  This  gives  the 
■ benef i t-of-the-doubt *  about  measurement  error  to  the 
individual  DMU,  reducing  reluctance  to  measurement. 


7.  DMUs  are  compared  only  to  similar,  efficient  DMUs. 
This  reduces  the  possibility  of  trying  to  compare 
“apples  and  oranges11. 

Data  Col  lection 

Air  Logistics  Center  Selection.  The  Sacramento  Air 
Logistics  Center  (SMALC)  was  selected  for  the  modeling 
effort.  Hq  AFLC  maintenance  productivity  managers  (22) 
suggested  the  SMALC  center  over  the  other  four  centers  for 
the  following  reasons: 

1.  SMALC  is  “typical*  of  AFLC  depot-level 
maintenance  activities.  Its  size  and  complexity 
suggest  successful  adaptation  of  DEA  and  CFA  to  this 
center  should  make  the  techniques  adaptable  to  other 
centers. 

2.  Several  of  the  individual  SMALC  maintenance 
functions  have  produced  the  same  types  of  items  over 
several  years  making  analysis  of  a  function  over  a 
period  of  time  meaningful. 

The  authors  agreed  wi th  Hq  AFLC  because  the  SMALC 
selection  conformed  to  a  DEA  modeling  assumption  that 
organizational  expertise  should  be  an  active  element  in  the 
input  and  output  selection  process  (3). 

Roger  P.  Dwyer,  Chief  of  the  Financial  management 
Section,  SMALC  Resources  Management  Division  (14),  was  asked 
to  select  a  “typical"  SMALC  shop  for  study.  Cwyer  selected 
the  Pneudraulic  Motor  and  Miscellaneous  Units  Resource 
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Control  Center  <RCC)  and  provided  sample  data.  This  RCC 
(hereafter  referred  to  as  the  hydraulic  shop)  repairs 
hydraulic  assist  components  of  C-130,  KC-135  and  other 
multi-engine  transport  aircraft.  The  hydraulic  shop  has  an 
experienced  and  stable  work  force  that  repairs  about  100 
types  of  components  per  fiscal  year.  Inputs  to  the  repair 
process  are  the  components,  repair  parts  and  materials, 
capital  investments  (machinery  and  shop  space),  utilities, 
labor  and  miscellaneous  administrative  expenses.  Dwyer's 
choice  of  the  hydraulic  shop  was  also  ideal  because  shop 
activities  were  extensively  documented. 

Two  types  of  analysis  were  considered:  (1)  comparison 
of  the  hydraulic  shop  to  other  similar  shops,  and  (2)  the 
hydraulic  shop  compared  to  itself  over  time.  Since  the 
hydraulic  shop  has  unique  outputs  compared  to  other  SMALC 
shops,  the  authors  decided  to  compare  the  hydraulic  shop  to 
i tse 1 f  over  time. 

Inputs  and  Outputs  Selected.  According  to  Clark,  input 
and  output  candidates  should  have  logical  appeal  (?).  For 
example,  to  be  a  logical  input  candidate,  an  increase  in  an 
input  quantity  should  have  the  effect  of  increasing  one  or 
more  outputs.  Organizational  goals  and  the  advice  of  local 
managers  should  also  be  considered  when  selecting  inputs  and 
outputs.  Finally,  to  maintain  acceptable  levels  of 
accuracy,  the  sum  of  the  numbers  of  inputs  and  outputs  used 


in  the  analysis  should  be  about  one  half  tne  number  of  DMU 


observations  (9). 


The  input  and  output  data  were  taken  from  Hq  AFLC  Data 
Collection  Forms  G035A  and  G019C  for  fiscal  /ears  1981 
through  1983  (samples  are  shown  in  Appendix  B  ).  Input  and 
output  values  were  actual  dollar  amounts  and  hours  recorded 
for  the  h/draulic  shop.  The  Form  G035A  data  (inputs)  were 
recorded  monthly.  However,  the  Form  G019A  data  (outputs) 
were  in  quarterly  form.  Because  of  this,  the  output  data 
limited  the  DEA  model  to  12  DMUs  representing  the  12 
quarters  of  three  consecutive  fiscal  years.  The  12  DMUs 
were  not  an  ideal  number  (only  six  or  seven  variables  could 
be  measured  simultaneously),  but  enough  to  demonstrate  the 
DEA  and  CFA  techniques.  If  output  data  were  captured 
monthly  instead  of  quarterly,  the  number  of  inputs  and 
outputs  measured  would  be  about  18  (half  the  36  months). 
Also,  if  the  hydraulic  shop  analysis  became  an  ongoing 
effort,  each  additional  quarter  of  data  would  allow  more 
inputs  and  outputs  to  be  measured  simultaneously,  providing 
increasingly  more  detailed  information  on  shop  efficiency. 

Working  with  Dwyer  (14),  the  authors  selected  four 
input  and  five  output  candidates.  Since  only  a  maximum  of 
six  or  seven  candidates  could  be  considered  in  each  analysis 
version,  many  combinations  of  these  variables  were  analyzed 
to  identify  the  important  relationships.  These  combinations 
are  described  later  in  this  chapter. 


The  monthly  input  -figures  were  summed  to  make  quarterly 


values.  Fiscal  Year  1981  was  established  as  the  base  year 
and  in-flation  adjustments  were  applied  to  Fiscal  Years  1982 
and  1983. 

Inputs.  The  -four  inputs  selected  were  actual  shop 
activity  hours,  labor  dollars,  material  dollars  and  "all 
other'  dollars  (administrative  and  miscellaneous).  These 
inputs  were  derived  -from  the  G035A  -forms  in  the  -following 
manner : 

1.  Shop  activity  hours  were  taken  directly  -from  the 
-forms. 

2.  Labor  dollars  were  a  combination  o-f  direct  and 
indirect  labor  dollars. 

3.  Material  dollars  were  a  combination  of  direct  and 
indirect  material  dollars. 

4.  All  other  dollars  were  calculated  by  subtracting 
labor  and  material  dollar  quantities  in  two  and  three 
above  from  the  total  dollar  expenditure  figures. 
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Sample  calculations  are  presented  in  Figure  2.  The  values 
o f  were  taken  -from  the  sample  hydraulic  shop  data  in 
Appendix  B.  Spec i f i cal  1 y ,  all  values  were  taken  from  the 
second  column  under  the  heading  "Actual". 


1 .  Labor  Hours 


2,912.9 

2 .  Labor  Pol  1 ars 


Direct  Labor 
+ 1 nd i r ec  t  Labor 
Labor  Dol 1 ars 


41 .368.88 
+  5. 579.01 

46.947.89 


3.  Material  Dollars 


Direct  Materials 
+  Indirect  Materials 
Material  Doll ars 


153,407.0 7 
+  3 . 380 . 66 
156,787.73 


4.  All  Other  Pol  1 ars 


Total  Cost 

-  Labor  Dol 1 ars 

-  Mater i al  dollars 
A1  1  Other  Dol 1 ars 


227,581 .22 
46,947.89 
156.789.73 
23,843.60 


Figure  2.  Sample  Calculation  of  Input  Variables  from 
Appendix  B  Data 


Outputs.  Because  there  were  about  90  different  output 
item-,  per  quarter,  a  method  of  combining  the  totals  was 
devised.  Since  the  portion  of  quarterly  shop  direct  labor 
hours  dedicated  to  individual  outputs  was  recorded,  the 
formula  in  Figure  3  was  used  to  assign  an  output  quantity 
for  each  item.  A  sample  calculation  is  shown  in  Figure  3 
using  values  of  one  output  item  (pump  4320001 62391 7HS> 
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extracted  from  the  Form  G019A  shown  in  Appendix  B.  The 
circled  numbers  represent,  (!)  the  time  the  shop  was 
credited  for  its  part  of  the  repair  and  (2)  the  number  of 
units  repaired.  For  this  item,  the  shop  hours  times  the 
number  of  units  repaired  per  quarter  was  the  output  quantity 
for  quarter  1  of  1983.  The  similarly  computed  output 
quantity  for  each  of  the  approx i mate  1 y  ninety  items  (see 
Appendix  C  for  each  item's  output  quantity)  was  then  summed 
for  a  total  output  quantity  for  the  hydraulic  shop  per 
quarter.  These  quarterly  output  quantities  were  used  in  the 
single  output  model. 

Another  model  tested  was  a  partial  output  model  that 
considered  only  those  individual  outputs  with  a  cumulative 
output  quantity  of  1000  or  more  for  the  three  year  period. 
Ignoring  the  individual  outputs  of  less  than  1000,  the 
totals  were  calculated  the  same  as  the  single  output  model. 
This  model  was  intended  to  show  managers  useful  results  can 
be  obtained  with  only  significant  portions  of  the  outputs 
consi dered. 

Also,  a  multiple  output  model  was  derived  by 
considering  the  output  quantities  of  the  two  individual 
items  with  the  highest  output  quantity  for  the  three  year 
period  separately  and  then  summing  the  remaining  individual 
outputs  for  a  third  quantity.  In  this  way  both  the  single 
and  multi tple  output  models  account  for  all  output  per 
quar ter . 


Figure  3  is  an  example  of  an  individual  output  quantity 
cal cul at i on . 

Shop  Direct  X  Number  of  I  terns  =  Output 

Activity  Hours  Repaired  Quantity 

5.7  Hours  X  5  I  terns  =  28.5  Units  of 

Ou  tpu  t 

Figure  3.  Sample  Calculation  of  Output  Quantities 
from  Appendix  B  Data 

Testing  the  Models 

Three  models  (single  output,  partial  output  and 
multiple  output)  were  formulated  to  analyze  the  hydraulic 
shop,  using  input  data  with  dollar  values  as  recorded  and 
adjusted  Tor  inflation.  Table  I  (page  36)  shows  the 
resulting  ten  tests.  The  authors  hypothesized  that  with 
each  model,  the  version  using  input  data  adjusted  for 
inflation  would  indicate  higher  productivity  in  1982  and 
1983  quarters  (1981  was  the  base  year  and  not  adjusted). 
Also,  it  was  hypothesized  that  of  the  four  inputs,  two 
(labor  hours  and  dollars)  would  account  for  the  same 
resource,  labor.  To  evaluate  this  possibility,  single 
output  tests  were  formulated  using  first  labor  hours  and 
then  labor  dollars  as  the  labor  resource  (Tests  3  through 
6)  . 

The  authors  also  hoped  to  show  additional  capabilities 


of  DEA  and  CFA  analyses.  Tests  7  and  8  (partial  output 
model)  used  data  only  from  26  of  the  93  individual  outputs 


when  the  criterion  of  a  cumulative  output  quantity  of  1000 
or  more  was  considered.  These  tests  were  designed  to  show 
that  use-ful  results  could  be  obtained  if  only  the  most 


repaired  items  were  evaluated.  Tests  9  and  10  were 
-formulated  to  evaluate  the  multiple  output  model.  It  was 
hoped  that  diagnostic  information  about  individual  items  o-f 
repair  could  be  shown. 

TABLE  I 
The  Tests 


Inputs 

One  Output 

(al 1  components 

combi ned) 

A1  1  Inputs 

No  Inflation 
Adjustment 

Test  1 

A1  1  Inputs 

With  Inflation 
Adjustment 

Test  2 

No  Labor  Hours 

No  Inflation 
Adjustmen  t 

Test  3 

No  Labor  Hours 
With  Inflation 
Adjustmen  t 

Test  A 

No  Labor  Dollars 
No  Inflation 
Adjustmen  t 

Test  5 

No  Labor  Dollars 
With  Inflation 
Adjustmen  t 

Test  6 

36 
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One  Output  Three  Outputs 
(top  26  (top  1  &  2 

combined)  +  all  others) 


Test  7 


Test  8 


Test  9 


Test  10 
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Summary* 


In  this  chapter  DEA  and  CFA  analyses  were  explained  and 
illustrated  with  an  example  (Figure  1).  The  piece  wise 
linear  -frontier  and  e-f-ficiency  calculations  were  explained 
in  detail  to  show  that  DEA  e-f-ficiency  ratings  are  relative 
and  based  on  the  empirical  data.  In  addition,  CFA,  an 
extension  o-f  the  DEA  technique,  provides  a  lower  bound  o-f 
e-f-ficiency  -for  inefficiently  rated  DMUs  and  more  detailed 
analysis  o-f  neighborhood  DMUs. 

Data  collection  methods  and  rational  were  explained. 
The  process  o-f  selecting  inputs  and  outputs  was  described  as 
was  the  formulation  of  the  three  models.  Finally,  the  ten 
tests  of  the  models  and  the  rationale  for  each  test  were 
discussed  along  with  some  of  the  expected  results.  The 
following  chapter  presents  the  analysis  of  each  test. 


IV.  Anal ysi s 

This  chapter  presents  the  analysis  of  each  test 
-formulated  in  the  previous  chapter  and  is  divided  into  three 
parts:  the  single  output  model,  the  partial  output  model, 
and  the  multiple  output  model.  An  analysis  of  the 
individual  models  is  presented  in  each  part  and  an  overall 
analysis  of  the  modeling  exercise  is  presented  in  the 
summary  at  the  end  of  the  chapter.  However,  before  the 
three  major  output  models  are  addressed,  a  brief  discussion 
of  computer  resources  and  the  data  base  is  presented. 

Computer  Softwares  and  Hardware 

To  incorporate  the  features  of  both  techniques,  the  DEA 
and  CFA  calculations  were  combined  into  one  computer 
program.  The  DEA  model  was  employed  first  to  find  all 
efficient  DMUs  and  the  upper  bound  of  efficiency  for  the 
inefficient  DMUs  that  were  not  frontier  units  (rated  less 
than  1.0  efficient).  Then,  CFA  was  employed  to  establish  a 
lower  bound  of  efficiency  for  the  inefficient  DMUs.  This 
allowed  each  DMU  to  be  rated  efficient  or  inefficient  within 
some  upper  and  lower  bound. 

The  computer  softwares  used  were  derived  from  routines 


developed  by  researchers  at  the  University  of  Texas  <UT) 
using  a  CDC  CYBER,  mainframe  computer.  The  softwares  were 
adapted  to  an  International  Business  Machines  Personal 
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Computer  <IBM  °C> ,  mini  class  computer  by  Captain  John 
Fraser,  a  fellow  graduate  student  (15).  This  use  of  the  IBM 
PC  was  possible  because  the  number  o-f  inputs  and  outputs 
from  the  hydraulic  shop  was  small  (seven  variables).  The 
specific  machine  used  was  an  expanded  IBM  PC  equipped  with 
512,000  (512K)  bytes  of  memory,  a  10  megabyte  harddisk,  2 
floppy  disk  drives  and  an  8087  IBM  numeric  processor.  The 
softwares  were  written  in  the  BASIC  computer  language  and 
executed  in  the  compiled  version.  Although  the  IBM  PC  had  a 
large  memory  capacity,  a  standard  <S4K  personal  computer 
could  have  provided  the  same  results  for  this  research  but 
at  a  slower  pace. 

The  Data  Base 

Input  Values.  Tables  II  and  IV  (pages  40  and  42 
respec t i ve 1 y)  show  the  input  quantities  used  to  evaluate  the 
hydraulic  shop.  Table  II  shows  the  values  of  input  hours 
and  dollars  with  no  adjustments  for  inflation.  Table  III 
(page  40)  shows  the  inflation  factors  used  to  adjust  the 
1982  and  1983  dollar  values  to  the  base  year,  1981.  The 
inflation  factors  originated  at  the  Office  of  the  Secretary 
of  Defense  for  Proposed  Budget  and  Sales  and  were  provided 
by  Hq  AFLC  (22).  Table  IV  dollar  values  reflect  the 


inflation  adjustments. 


Observed 

Quarter 

Labor 

Hours 

Total  Labor 
Do!  lars 

Total  Material 
Dol 1 ar s 

All  Other 
Dol 1 ars 

1981 

1 

6,691 

107,506 

391 ,058 

68,001 

2 

7,358 

118,127 

502,578 

79,941 

3 

7,907 

129,197 

585,656 

65,046 

4 

7,534 

124,016 

471 ,364 

56,482 

1982 

5 

6,979 

138,725 

71 1 ,876 

78,649 

6 

8,165 

141 ,960 

583,037 

83,902 

7 

10,134 

196,975 

945,082 

114,295 

8 

8,958 

166, 159 

1 ,081 ,340 

93,634 

1983 

9 

7,148 

132,931 

388,81 1 

88,376 

10 

9,121 

149,942 

1 ,228,537 

108,818 

1  1 

7,396 

139,392 

1 ,382,716 

97,966 

12 

8,809 

145,555 

1 , 114,040 

99,601 

The  1932  labor  dollars  were  reduced  by  5.5  percent  in 
observed  quarters  7  through  10  because  Sacramento  Air 
Logistics  Center  payroll  increases  were  not  effective  until 
April,  the  beginning  of  the  third  quarter  of  the  fiscal 
year.  Observed  quarters  11  and  12  were  first  reduced  by  5.0 
percent  for  1983's  inflation  and  then  by  5.5  percent  for 
1982's  inflation  to  arrive  at  a  1981  base  year  labor  dollar 
fiqure.  Similarly,  material  dollars  and  all  other  dollars 
were  reduced  by  Table  Ill's,  inflation  factors  for  each  year. 


TABLE  III 

Inflation  Factors  Applied  to  Inputs 


Var i abl e 

1982  Percentage 

1983  Percentage 

Total  Labor  Dol 1 ars 

5.5  * 

5.0  7 

Total  Material  Dollars 

10.2  X. 

13.6  7 

A1 1  Other  Dol 1 ars 

11.5  7. 

6.1  7 

W|I 
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The  -following  example  o-f  cross  multiplication 
demonstrates  how  inflation  adjustment  calculations  were  made 
using  1982  Total  Labor  Dollars  from  observed  quarter  7 
(Table  II)  and  applying  the  1982  labor  inflation  factor 
(Table  III)  to  compute  inflation  adjusted  Total  Labor 
Dollars  for  observed  quarter  7  (Table  10). 

Quarter  7  Total  Labor  Dollars  =  1QQ  percent 

$  196,975  105.5  percent 

i nf 1  at i on 

Quarter  7  Total  Labor  Dollars  =  186,706  (7 

The  next  example  demonstrates  how  inflation  adjustment 
calculations  were  made  using  1983  Total  Labor  Dollars  from 
observed  quarter  11  (Table  II)  and  applying  the  1982  and 
1983  labor  inflation  factors  (Table  III)  to  compute 
inflation  adjusted  Total  Labor  Dollars  for  observed  quarter 
11  (Table  IV). 


Quar  ter 

1 1 

Total 

Labor 

Dol 1 ar s 

a 

100  percent 

*  139, 

392 

105  percent 
inflation 

Quar  ter 

1 1 

Total 

Labor 

Dol 1 ar s 

a 

132,754 

Quarter 

1 1 

Total 

Labor 

Dol 1 ar s 

— 

100  percent 

*  132, 

754 

105.5  percent 

inflation 


Quarter  11  Total  Labor  Dollars 


125,833 


Observed 

Quarter 

Labor 

Hours 

Total  Labor 
Dol 1 ars 

Total  Material 
Dol 1 ars 

A1 1  Other 
Dol 1 ars 

1981 

1 

6,691 

107,506 

391 ,058 

68,001 

2 

7,358 

118,127 

502,578 

79,941 

3 

7,907 

129,197 

585,656 

65 , 046 

4 

7,534 

124,016 

471 ,364 

56,482 

1 982  | 

5 

6,979 

138,725 

645,985 

70 , 537 

6 

8,165 

141 ,960 

529,072 

75,248 

7 

10,134 

186,706 

857,606 

102,507 

8 

8,958 

157,497 

981 ,252 

83,977 

1 983 

9 

7,148 

126,001 

709 , 986 

75,127 

10 

9,121 

142,125 

981 ,360 

91 ,983 

11 

7,396 

1 25 , 833 

1 ,104,518 

82,810 

12 

8,282 

131 ,397 

889,899 

84,193 

Output  Values.  Tables  V,  VI  and  VII  (pages  43,  55  and 
59,  respectively)  show  the  output  values  used  to  evaluate 
the  hydraulic  shop.  Table  V  shows  the  output  values  -For  the 
single  output  model  (Tests  1  through  6)  which  are  total 
output  quantities  -for  each  observed  quarter.  Table  VI 
(shown  in  Part  II)  shows  the  output  values  for  the  partial 
output  model  (Tests  7  and  8),  which  are  totals  of  the  top  26 
items  (with  an  output  quantity  of  1000  or  more  for  all  three 
years)  repaired  by  the  hydraulic  shop.  Table  VII  (shown  in 
Part  III)  shows  the  output  values  for  the  multiple  output 
model  (Tests  9  and  10). 


Part  I.  Single  Output  Model 


This  portion  adoresses  the  results  and  analysis  of  the 
single  output  model  (Tests  1  through  6)  using  the  output 
data  -from  Table  V  (see  below).  For  each  test,  a  graphical 
display  o-f  the  results  appears  shewing  the  upper  and  lower 
bounds  o-f  e-f-ficiency  -for  each  observed  quarter  (DMU).  The 
upper  and  lower  bounds  o-f  e-f-ficiency  are  displayed  on  the 
top  two  curves  and  the  total  output  quantity  on  the  single 
curve  below.  The  reader  should  note  the  double  scale  on  the 
u®"  ‘  :  ;al  axis  o-f  the  left  side  o-f  each  graph.  The  decimal 
value  scale  is  associated  with  the  two  efficiency  lines  on 
the  top  part  of  the  graph,  while  the  other  scale  is 
associated  with  output  quantities  (value  times  1000)  shown 
as  the  bottom  line  of  the  graph. 

The  following  table  shows  the  single  output  quantities 
for  Tests  1  through  6. 

TABLE  V 

Output  Quantities  for  Tests  1  -  6 


Observed 

Quarter 

Ou  tpu  t 

Qu  an  t  i  t  y 

Observed 

Quar  ter 

Output 
Quan  t i ty 

1981 

1 

4,9 67.7 

7 

10,823.5 

2 

5,335.8 

8 

8,416.0 

3 

7,024.4 

1983 

4 

7,283.8 

9 

7,581 .1 

1982 

10 

9,742.7 

5 

7,840.8 

1  1 

8,165.0 

6 

8,028.7 

12 

8,837.2 

Test  1  Analysis.  The  authors  considered  Test  1  the 
most  comprehensive  test  o-f  the  DEA  and  CFA  technique  in  this 
research  project  for  two  reasons.  First,  the  model  includes 
all  inputs  and  accounts  for  all  the  hydraulic  shop 
production  in  a  single  output.  Second,  since  no  adjustments 
were  made  for  inflation,  the  model  was  permitted  to  evaluate 
purely  observed  values  while  taking  into  account  all  the 
interactions  and  trade-offs  including  the  increasing  costs 
of  resources.  On  the  other  hand,  when  eroding  buying  power 
from  one  fiscal  year  to  the  next  is  considered,  this  model 
may  not  accurately  represent  the  dollar  value  of  labor 
effort  or  volume  of  material  resources. 

Looking  at  the  DEA  and  CFA  results  in  Figure  4, 
observed  quarters  1  and  2  are  the  least  efficient  and 
observed  quarters  4,  5  and  10  are  the  frontier  units  (1.0 
rating).  The  quarter  with  highest  output,  observed  quarter 
7,  is  not  the  most  efficient  but  does  show  a  dramatic 
increase  in  input  and  output  with  only  a  slight  loss  in 
efficiency  of  2  percent  from  the  frontier  DMUs.  This 
suggests  that  slightly  more  inputs  were  used  in  observed 
quarter  7  than  were  needed  for  the  higher  output.  This 
result,  combined  with  the  relatively  low  efficiency  ratings 
and  low  production  levels  of  observed  quarters  1  and  2, 
suggests  a  reserve  production  capacity  that  cannot  be  easily 
reduced  when  production  demands  are  low.  This  reserve 
capacity  is  likely  attributed  to  the  fixed  assets  such  as 
the  permanent  work  force,  administrative  costs  and  capital 
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investments.  The  management  actions  necessary  to  achieve 
the  high  output  in  observed  quarter  7  may  also  have 
contributed  to  the  lower  efficiency  rating  in  observed 
quarter  8.  The  after  effects  o-f  a  production  surge,  a 
residual  temporary  work  force,  or  unused  materials  may  have 
lowered  the  efficiency  rating. 

Observed  quarters  4,  5  and  10  should  be  considered  good 
examples  of  the  proper  mix  of  inputs  for  the  respective 
outputs.  Since  lower  efficiency  ratings  suggest  less 
efficient  use  of  resources,  management  should  look  for  ways 
to  improve  this  use.  The  results  do  not  suggest  seasonality 
trends  in  efficiency.  However,  when  considering  the  upper 
bounds  of  efficiency  for  each  year,  a  trend  does  develop 
that  suggests  a  general  increase  in  efficiency  from  the 
beginning  to  the  end  of  the  test  period. 
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4  5  6  7  8  9  10  11 

Observed  Quarters 


Observed 

1  Lower 

Upper 

Output 

Quar ter 

Bound 

Bound 

Quant i ty 

1981 

1 

.566 

.822 

4967.7 

2 

.700 

.761 

5335.8 

3 

.906 

.910 

7024.4 

4 

1  .000 

1.000 

7283.8 

1982 

5 

1 .000 

1  .000 

7840.8 

6 

.909 

.981 

8028.7 

7 

.950 

.981 

10823.5 

8 

.845 

.872 

8416.0 

1983 

9 

.944 

.962 

7581 .1 

10 

1  .000 

1.000 

9742.7 

1  1 

.910 

.997 

8165.0 

12 

.947 

.950 

8837.2 
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Test  2  Analysis.  As  hypothesized,  the  input 
adjustments  for  inflation  improved  the  efficiency  ratings 
for  1982  and  1983,  observed  quarters  5  through  12.  Observed 
quarters  4,  5  and  10  remain  on  the  frontier  (1.0  rating) 
while  two  more  efficient  observed  quarters,  6  and  11,  are 
added  to  the  frontier.  The  overall  efficiency  improvement 
in  the  later  observed  quarters  makes  intuitive  sense  because 
it  now  takes  less  input  resources  (measured  by  dollars)  to 
produce  the  same  output.  The  first  three  observed  quarters 
are  affected  only  slightly  by  the  inflation  adjustment  and 
retain  their  relative  positions  to  the  others.  This  test 
could  be  considered  the  most  accurate  if  the  inflation 
adjustments  correctly  represent  the  real  dollar  values  of 
labor  and  material  resource  inputs. 

A  trend  of  improvement  is  found  in  both  Test  1  and  2. 
When  averaging  the  upper  bounds  of  efficiency  for  each  year, 
each  year's  efficiency  increases.  This  strongly  suggests 
management  converted  resources  into  output  more  efficiently 
in  1982  and  1983  than  in  1981. 


Tests  3  and  4  Analysis.  Tests  3  and  4  evaluated 


one  output  and  three  inputs  that  excluded  the  labor  hours 
input.  Test  4  Mas  accomplished  using  in-flation  adjusted 
input  data.  The  in-flation  adjustment  had  the  same  general 
effect  as  in  Tests  1  and  2.  The  efficiency  ratings  -for  the 
1981  observed  quarters  Mere  slightly  changed  Mh i 1 e  the 
e-f-f  i  c  i  enc  i  es  o-f  the  1982  and  1983  observed  quarters 
improved.  Additionally,  the  average  yearly  upper  bounds  o-f 
efficiency  increased  as  in  Tests  1  and  2. 

However,  there  is  a  difference  from  the  first  two 
tests.  The  effects  of  excluding  the  labor  hours  input  on 
observed  quarters  5,  6  and  11  illustrates  the  benevolence  of 
the  DEA  and  CFA  techniques.  Observed  quarters  6  and  11  do 
not  move  to  the  frontier  from  Test  3  to  Test  4  and  observed 
quarter  5  is  not  rated  as  a  frontier  unit  in  either  Test  3 
or  4.  With  Tests  1  and  2,  the  more  inefficiently  used 
inputs  were  ignored  in  the  calculations  as  the  model  worked 
to  award  the  highest  possible  efficiency  ratings.  By 
removing  labor  hours  the  model  is  forced  to  consider  labor 
dollars,  a  sometimes  less  efficiently  used  resource.  This 
results  in  lower  efficiency  ratings  for  some  DMUs;  however, 
the  general  relationships  of  the  12  DMUs  are  preserved.  A 
possible  explanation  for  the  two  models  arriving  at 
different  results  could  be  that  the  allocation  of  labor 


costs  to  the  hydraulic  shop  and  the  shop's  process  of 
recording  labor  hours  are  somewhat  independent. 


Output  E-f-ficiency 
Qty 
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Observed 
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Upper 

Output 

Quarter 

Bound 

Bound 

Quant  i  t: 

1981 

1 

.566 

.822 

4967.7 

2 

.708 

.761 

5335.8 

3 

.909 

.910 

7024.4 

4 

1  .000 

1  .000 

7283.8 

1982 

5 

.922 

.932 

7840.8 

6 

.914 

.956 

8028.7 

7 

.892 

.914 

10823.5 

8 

.809 

.827 

8416.0 

1983 

9 

.896 

.908 

7581 . 1 

10 

1  .000 

1  .000 

9742.7 

1  1 

.869 

.909 

8165.0 

12 

.946 

.948 

8837.2 
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Tests  5  and  6  Analysis.  Tests  5  and  6  evaluated 
one  output  and  three  inputs  that  excluded  labor  dollars  and 
included  labor  hours.  Test  5  was  not  adjusted  for  inflation 
while  Test  6  included  an  adjustment.  The  general 
relationships  of  the  observed  quarters  were  similar  to  the 
previous  models,  but  differences  were  identified.  Observed 
quarter  5  returned  to  the  frontier  as  in  Tests  1  and  2  and 
remained  there  with  the  inflation  adjustment  in  Test  6. 
Observed  quarter  6  was  rated  efficient  and  added  to  the 
frontier  in  Test  6.  However,  observed  quarter  10  was  not 
rated  efficient  in  either  Test  5  or  6,  as  it  was  in  the 
first  four  tests.  Also,  the  average  yearly  upper  bounds  of 
efficiency  did  not  increase  from  1982  to  1983. 

These  results  support  the  suggestion  in  the  previous 
section  that  labor  hours  and  labor  dollars  are  allocated  to 
the  hydraulic  shop  independently.  Depending  on  which 
measure  of  labor  is  used,  some  observed  quarters  are  rated 
differently  and  the  frontier  changes  significantly. 
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Observed 

Lower 
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Output 

Quarter 

Bound 

Bound 

Quant i ty 

1981 

1 

.566 

.822 

4967.7 

2 

.655 

.733 

5335.8 

3 

.877 

.891 

7024.4 

4 

1  .000 

1  .000 

7283.8 

1982 

5 

1  .000 

1  .000 

7840.8 

6 

.909 

.981 

8028.7 

7 

.950 

.981 

10823.5 

8 

.784 

.862 

8416.0 

1983 

9 

.874 

.944 

7581 . 1 

10 

.852 

.951 

9742.7 

1 1 

.756 

.983 

8165.0 

12 

.822 

.893 

8837.2 

Figure  8.  Test  5,  One  Output,  Inputs  Not  Adjusted  -for 
Inflation  with  No  Labor  Dollars 
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The  single  output  model  tests,  although  different  in 
some  respects,  do  show  similarities.  The  -first  two  observed 
quarters  received  the  lowest  efficiency  ratings  in  all  six 


tests.  Also  in  Tests  1  through  4,  the  average  yearly  upper 
bound  e-f-ficiency  rating  increased  each  year  -from  1981 
through  1983.  This  suggests  an  increase  in  productivity  as 
measured  by  technical  efficiency.  However,  when  the  tests 
were  -forced  to  evaluate  e-f-ficiency  using  labor  hours  and  not 
labor  dollars  in  Test  5  and  6,  e-f-ficiency  did  not  improve 
from  1982  to  1983  as  in  the  previous  tests. 

Part  II.  Partial  Output  Model 

Tests  7  and  8  Analysis.  Tests  7  and  8  were 
designed  to  evaluate  all  input  expenditures  to  the  output 
quantities  of  the  26  most  repaired  items  listed  in  Table  VI 
below. 

TABLE  VI 

Output  Quantities  for  Tests  7  and  8 


Observed 

Output 

Output 

Quarter 

Quan  t i ty 

Quarter 

Quantity 

1981 

1 

3689.4 

7 

9085.8 

2 

3936.7 

8 

6647.5 

3 

5736.5 

1983 

4 

5405.6 

9 

5940.2 

1982 

10 

7481 . 1 

5 

6411.8 

1  1 

5955.1 

6 

6641 .6 

1  2 

6679.7 

55 


If  estimates  in  efficiency  ratings  are  all  that  are  needed 
for  management  decisions,  then  substantial  efforts  to 
collect  data  may  be  saved. 

The  reader  should  note  that  the  output  quantity  scales 
in  Figures  10  and  11  have  changed.  The  graph  begins  at  3000 
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Part  III.  Multiple  Output  Model 

Tests  9  and  10  Analysis.  These  two  tests  were  employed 
to  evaluate  three  outputs  and  -four  inputs.  Test  9  was  not 
adjusted  -for  inflation,  while  Test  10  include  an  adjustment. 
Table  VII  shows  the  values  o-f  the  Outputs  1,  2  and  3. 

Outputs  1  and  2  were  two  items  repaired  by  the  hydraulic 
shop  with  the  highest  individual  output  quantities  over  the 
test  period.  Output  3  represents  a  combined  output  quantity 
o-f  all  other  items  in  the  hydraulic  shop.  It  was  hoped  an 
individual  analysis  o-f  Outputs  1  and  2  would  reveal 
additional  in-formation  useful  to  management.  The  graphs  in 
Figures  12  and  13  do  not  show  the  output  quantity  since 
multiple  outputs  cannot  be  displayed. 


TABLE  VII 

Three  Output  Quantities  -for  Tests  9  and  10 


Observed 

Quarter 

1981 

1 

2 

3 

4 

1982 

5 

6 

7 

8 

1983 

9 
10 
1 1 
12 


Output  1  Output  2 


43.5 

377.0 

745.0 

594.5 

493.0 

609.0 

609.0 

797.5 

681 .5 

739.5 

768.5 
551  .0 


365.7 

402.8 

413.4 

339.2 

312.7 

323.3 
434.6 
339.2 

439.9 
731  .4 
159.0 

238.5 


Output  3 


4558.5 
4556 . 0 
5857 . 0 
6350.0 

7035.1 

7096.4 
9779.9 
7279.3 

6459.7 

8271 .8 

7237.5 
8047.7 


This  model  produced  little  information  considered 
useful  to  management.  The  results  of  Test  9  showed  only 
three  observed  quarters  (6,  7  and  8)  as  less  than  efficient. 
In  Test  10  with  the  inflation  adjustment,  the  number  of 
inefficient  observed  quarters  was  reduced  to  two,  quarters  2 
and  8.  This  information  does  not  support  the  results  of 
the  single  and  partial  output  models  that  consistently  rated 
observed  quarters  1,  2,  3,  8,  9  and  12  inefficient. 

These  results  show  a  limitation  of  the  DEA  and  CFA 
techniques  when  used  for  small  data  sets.  As  in  Tests  3 
through  6,  the  benevolence  of  the  DEA  and  CFA  models  is  a 
factor.  By  dividing  the  total  output  quantity  into  two 
small  quantities  and  one  large  quantity,  the  model  was  given 
considerable  freedom  to  ignore  inefficient  parts  of  the 
output  data.  The  model's  efforts  to  assign  the  highest 
possible  efficiency  rating  degrades  the  diagnostic  value  of 
the  results  by  regarding  all  but  a  few  observed  quarters  as 
efficient.  The  model  designer  should  consider  the 
diagnostic  limitations  of  a  model  with  too  few  observations. 

Although  the  multiple  output  formulation  was  not  the 
best  configuration  for  this  small  data  set,  its  usefulness 
should  not  be  disregarded.  If  a  large  set  of  observations 
had  been  used  so  that  the  hydraulic  shop  could  be  modeled 
with  each  production  item  as  a  separate  output,  then  a 
multiple  output  results  may  have  been  valuable. 
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3 
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4 
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5 

1  .000 
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6 
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7 
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8 
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9 
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10 
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1 1 

1  .000 

1  .000 

12 

1  .000 

1  .000 

Figure  12.  Test  ?,  Three  Outputs,  Inputs  Not  Adjusted  -for 
I nf 1  a  t i on 
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1 
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1  .000 

2 
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.997 

3 

1  .000 

1  .000 

4 

1  .000 

1  .000 
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5 

1  .000 

1  .000 

6 

1  .000 

1  .000 

7 

1  .000 

1  .000 

8 
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9 

1 .000 
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Figure  13.  Test  10,  Three  Outputs,  Inputs  Adjusted  -for 
I  n-f  1  at  i  on 
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Summary 

The  single  output  model  (Tests  1  through  6) 
demonstrated  the  sensitivity  of  the  DEA  and  CFA  analysis 
techniques  to  the  data  charac  ter  i  st  i  cs  o-f  this  study. 

Changes  such  as  the  inflation  adjustment  produced  consistent 
results  over  several  formulations.  The  differing  results  of 
Tests  3  and  4  and  Tests  5  and  6  demonstrated  the  importance 
of  the  input/output  selection  process.  The  first  six  tests 
taken  together  also  show  DEA/CFA  modeling  flexibility  that 
allows  the  model  designer  to  tailor  the  analysis  to  specific 


user  needs. 


The  results  of  the  partial  output  model  (Tests  7  and  3> 
show  the  feasibility  of  using  DEA/CFA  analyses  with  only 
part  of  the  output  that  is  considered  significant.  On  the 
other  hand,  the  multiple  output  model  (Tests  9  and  10> 
results  showed  that  there  are  limitations  to  using  partial 
output  in  the  analysis.  Providing  a  DEA/CFA  model  too  much 
freedom  degrades  the  usefulness  of  the  results  showing 
attention  must  be  paid  to  the  size  of  the  data  base  and  the 
nature  of  the  outputs. 

In  Chapter  V,  the  validation  of  this  chapter  will  be 
reported.  In  Chapter  VI,  the  authors  will  draw  conclusions 
about  the  research  effort  and  recommend  further  research  and 


applications  of  the  DEA  and  CFA  analysis  techniques. 


V.  Val i dat i on 


The  -final  step  in  the  research  effort  is  a  two-stage 
validation  process.  The  first  stage  is  a  verification  of 
the  accuracy  of  the  DEA  and  CFA  mathematical  calculations  by 
performing  identical  tests  on  the  University  of  Texas  <UT) 
COC  CYBER  computer,  using  the  originally  developed  DEA  and 
CFA  softwares.  The  second  stage  is  an  interpretation  of  the 
modeling  results  by  using  managers.  I n terpre tat i on  of 
results  by  using  managers  would  suggest  that  DEA  and  CFA 
productivity  measurement  techniques  in  the  AFLC  maintenance 
environment  are  useful  and,  more  importantly,  acceptable  to 
managers. 


University  of  Texas  <UT) 

The  mathematical  results  of  the  ten  tests  reported  in 
the  previous  chapter  were  similar  to  the  UT  CYBER  results. 
However,  there  were  some  differences  and  some  insights 
discovered  in  the  results. 

Differences.  A  slight  difference  in  large  numbers 
was  attributed  to  numerical  rounding  differences  between  the 
two  computers.  However,  the  rounding  differences  did  not 
affect  any  significant  digits  in  the  results. 

Also,  a  difference  in  computer  software  features  did 
affect  the  assignment  of  lower  bounds  of  efficiency  for  some 


observed  quarters.  This  occurred  because  of  different 
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stopping  rules  in  Fraser's  versus  UT's  software.  As 
optimization  models,  OEA  and  CFA  must  have  a  predetermined 
stopping  point  where  the  next  iteration  of  results  is  not 
considered  any  better  because  of  some  property  associated 
with  the  calculations.  Fraser's  softwares  directed  the  CFA 
model  to  calculate  the  lowest  efficiency  rating  possible  for 
a  given  inefficient  DMU  relative  to  the  frontier  set  of 
efficient  observed  quarters.  The  UT  softwares  used  the  same 
CFA  procedure  but  calculated  the  maximum  of  the  lower  bounds 
relative  to  the  frontier  set  of  efficient  observed  quarters. 

According  to  CLark  <9>,  either  method  of  establishing  a 
lower  bound  can  be  considered  valid.  The  most  appropriate 
stopping  rule  should  be  determined  by  examining  the  planned 
uses  for  the  results.  Fraser's  stopping  rule  for  displaying 
the  lower  bound  was  considered  more  useful  for  this  research 
because  managers  could  use  the  information  for  worst  case 
p 1 ann i ng . 

Insights.  The  effect  of  differing  correlation 
relationships  among  inputs  and  among  outputs  on  the 
efficiency  rating  was  examined  at  UT.  Dr.  Athella  Bessent, 
associate  professor  at  UT  and  a  CFA  co-developer  (2), 
suggested  that  an  input  should  have  a  negative  rate  of 
substitution  with  another  input  and  likewise  for  outputs. 
Current  research  at  UT  suggests  that  by  selecting  inputs 
with  negative  rates  of  substitution  an  optimization  model 
such  as  DEA  or  CFA  is  able  to  consider  a  mix  of  those  two 
inputs  versus  selecting  one  input  or  the  other  to  compute 
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efficiency  ratings.  However,  if  two  inputs  are  selected 
which  have  a  highly  positive  correlation,  the  efficiency 
ratings  would  be  essentially  the  same  if  one  or  the  other  or 
both  variables  were  included  in  the  analysis. 

For  this  research,  input  to  input  and  output  to  output 
correlations  were  calculated  to  screen  inputs  and  outputs 
for  rates  of  substitution.  These  correlations  showed 
positive  rates  of  substitution  among  the  inputs  and  negative 
rates  among  the  outputs  in  the  multiple-output  model. 
Therefore,  additional  tests  of  the  multiple-output  model 
were  devised  using  one  input  at  a  time  compared  to  the  three 
outputs.  The  results  showed  better  formed  frontiers  with 
the  one  input,  multiple-output  formulation.  The 
implications  were  that  inputs  and  outputs  with  negative 
rates  of  substitution  re  1  at i onsh i ps  should  be  selected. 

These  results  are  not  conclusive  and  were  only  intended  to 
add  to  the  current  body  of  UT  research.  Future  DEA/CFA 
research  should  check  with  UT  for  progress  in  this  area. 
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i  sties  Center  <SMALC> 


The  importance  of  i ncorpor at i ng  management  as  well  as 
modeling  expertise  in  model  design  cannot  be  overstated. 

The  close  cooperation  between  the  users  and  model  designers 
is  essential  for  meaningful  and  valid  results.  The 
following  presents  observations  of  a  tour  in  the  hydraulic 
shop  and  the  authors''  personal  interviews  with  managers  that 
were  familiar  with  this  shop. 

Hydraulic  Shop.  The  hydraulic  shop  was  originally 
chosen  by  AFLC  managers  for  this  research  because  of  its 
degree  of  stability  and  autonomy  as  a  process.  However, 
direct  observation  of  the  work  environment  showed  several 
batch  process  situations  and  considerable  "farming  out"  of 
work.  Although  disassembly  and  reassembly  of  components 
were  accomplished  in  the  hydraulic  shop,  other  processes, 
such  as  performance  testing  or  welding,  were  usually 
performed  elsewhere. 

The  DEA  and  CFA  modeling  reflects  the  effects  of  these 
subprocess  efficiencies  on  the  efficiency  of  the  shop  as  a 
whole.  However,  different  choices  in  the  input/output 
selection  process  may  have  improved  the  efficiency  diagnosis 
of  the  results.  There  were  numerous  instances  of 
interactive  effects  among  subprocesses.  For  example,  if 
direct  and  indirect  costs  had  not  been  combined,  natural 
trade-offs,  such  as  labor  versus  machine  intensive 
operations,  may  have  been  easier  to  identify.  The  impact  on 
shop  efficiency  of  these  subprocesses  should  be  considered 


when  determining  the  efficiency  of  shops  in  future  research. 

Personal  Interviews.  At  SMALC,  the  resul ts  were 
presented  to  James  Wallen,  Deputy  Chief  of  the  Resources 
Management  Division,  members  of  his  staff,  and  George 
Klinas,  Supervisor  of  the  Pneudraulic  Motor  and 
Miscellaneous  Unit  Resource  Control  Center  < the  hydraulic 
shop)  <24>.  Additional  conversations  were  held  with  Ron 
Orr,  Chief  of  the  Industrial  Products  Division,  and  others 
within  the  Directorate  of  Maintenance  <24>.  In  each  case, 
these  managers  considered  the  inputs  and  outputs  and  the 
results  of  the  modeling  effort  as  accurate  and  useful 
information  for  management  decision  making.  Al  thougi. 
detailed  historical  documentation  of  the  hydraulic  shop  was 
not  available  for  comparison,  observations  made  and  opinions 
expressed  by  Mr.  Klinas  and  others  were  considered  support 
for  the  validity  of  the  modeling  results. 

Mr.  Uallen  was  fascinated  by  the  possibilities  of  DEA 
and  CFA  and  expressed  interest  in  an  expanded  study.  He 
wished  to  continue  the  hydraulic  shop  research,  doing  an 
analysis  that  included  tracking  the  effects  on  efficiency  of 
a  planned  shop  reorganization  and  move  to  a  new  facility. 
Also,  he  wished  to  see  the  techniques  applied  to  other  shops 
with  different  types  of  resources  and  production  flows.  Mr. 
Orr  concurred  with  Mr.  Wallen  and  wished  to  see  DEA  and  CFA 
analyses  applied  to  shops  in  the  Industrial  Products 


Although  upper  and  middle  management  acceptance  of 
DEA/CFA  modeling  is  encouraging,  acceptance  by  first  line 
management  is  equally  important.  Discussions  with  the 
hydraulic  shop  supervisor,  Mr.  Klinas,  provided  several 
insights  to  questions  raised  in  Chapter  IV.  Mr.  Klinas 
believed  that  the  sharp  increase  in  output  quantity  in 
observed  quarter  7  was  probabl y  caused  by  the  hydraulic  shop 
assuming  additional  responsibilities.  In  observed  quarter 
7,  the  hydraulic  shop  was  merged  with  another  shop  and 
simultaneously  a  dramatic  increase  occurred  in  the  overhaul 
o-f  some  F-15  tactical  fighter  hydraulic  components.  The 
DEA/CFA  results  indicate  a  successful  merger  and  smooth 
production  increase  since  there  was  a  98  percent  efficiency 
rating  for  the  observed  quarter  (reported  in  Test  1  and  2  of 
Chapter  IV).  Additionally,  Mr.  Klinas  was  reasonably  sure 
that  the  drop  in  efficiency  in  observed  quarter  8  could  be 
attributed  to  a  residual  temporary  work  force  and  some  lags 
in  the  accounting  process  from  the  previous  quarter. 


Summary 

The  results  of  measuring  the  technical  efficiency  of 
the  hydraulic  shop  were  enthusiastically  accepted  by  the 
SMALC  managers.  In  addition,  management  planned  to 
incorporate  DEA/CFA  into  their  computer  facilities  and 
continue  analysis  of  the  hydraulic  shop  while  undertaking  an 
analysis  of  other  shops. 

The  validation  process  is  valuable  to  understanding  the 
usefulness  and  implications  of  the  research  findings.  It 
confirmed  that  the  IBM  PC  computer  softwares  were  logically 
correct  and  the  results  were  computed  correctly.  Knowing 
the  effects  of  optimization  stopping  rules,  rates  of 
substitution  among  variables  and  the  effects  of  subprocesses 
are  necessary  considerations  for  future  DEA/CFA  modeling 
efforts. 


In  retrospect,  many  of  the  observations  made  and 
lessons  learned  after-the-fact  in  the  validation  stage  would 
have  enhanced  the  modeling  effort  considerably  if  the 
information  had  been  available  earlier.  However,  the 
purpose  of  this  research,  to  evaluate  the  feasibility  of 
using  the  DEA/CFA  techniques  in  a  ALC  maintenance 
environment,  was  successfully  accomplished  and  accepted  by 
SMALC  and  HQ  AFLC  managers  as  a  valid  way  of  measuring 
productivity  in  their  organization. 


VI .  Conclusions  and  Recommendations 

The  -following  presents  the  conclusions  and 
recommendations  of  this  thesis.  The  conclusion  restates  the 
research  problem  and  then  summarizes  the  results  of  each 
objective  from  Chapter  I.  The  recommendations  are  presented 
by  the  authors  for  future  research  efforts. 

Cone  1  us i ons 

Chapter  I  presented  the  thesis  problem  and  a  list  of 
the  five  research  objectives.  The  problem  stated  was  that 
Air  Force  Logistics  Command  has  been  unsuccessful  in 
measuring  productivity  since  past  measurement  techniques 
were  insufficient.  This  was  stated  in  an  HQ  AFLC  thesis 
proposal  <16)  and  confirmed  in  interviews  with  managers  at 
HQ  AFLC  <  22)  and  SMALC  <I4>. 

Objective  One.  The  first  objective,  (1)  to  define 
productivity  for  AFLC  depot-level  maintenance,  is  met  with 
the  literature  review  in  Chapter  II.  Productivity  is 
traditionally  defined  as  some  function  of  effectiveness  and 
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efficiency.  For  purposes  of  this  research,  effectiveness  is 
combining  all  inputs  into  useful  outputs,  whereas, 


efficiency  is  the  conservation  of  input  resources  while 


producing  a  maximum  number 
measured  technical  efficien 
while  assuming  outputs  meet 


of  outputs.  This  research 
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the  organization. 

Objectives  Two  and  Three.  The  third  chapter 
accomplishes  objectives  two  and  three,  which  are:  (2)  to 
establish  criteria  and  select  input  and  output  measurements, 
and  (3)  to  develop  the  relationship  between  selected  inputs 
and  outputs  using  DEA  and  CFA.  DEA  and  CFA  analyses  was 
explained  and  illustrated  in  detail  to  show  that  DEA  and  CFA 
efficiency  ratings  are  relative  and  based  on  the  empirical 
data.  The  process  of  selecting  inputs  and  outputs  was 
accomplished  with  the  help  of  Dwyer  (14),  illustrating  the 
need  for  close  cooperation  between  managers  and  modelers 
early  in  the  modeling  process.  The  relationships  between 
selected  inputs  and  outputs  were  formulated  into  three 
models  representing  ten  tests.  The  rationale  for  each  test 
was  discussed  along  with  some  of  the  expected  results. 

Objective  Four.  The  groundwork  for  objective  four,  <4> 
evaluating  the  DEA  and  CFA  models  using  AFLC  data,  begins  in 
Chapter  IV  and  is  validated  in  Chapter  V.  The  single-output 
model  (Tests  1  through  6)  showed  the  flexibility  available 
with  DEA/CFA's  models  to  tailor  the  analyses  to  specific 
user  needs.  Tests  1  and  2  were  considered  the  most  accurate 
since  they  evaluated  all  the  selected  inputs  and  outputs 
simultaneously.  The  results  of  the  partial  output  model 
(Tests  7  and  8)  show  useful  results  can  be  obtained  when 
only  significant  portions  of  the  output  quantities  are 
considered.  This  model  could  be  considered  useful  when  data 
collection  is  expensive  (in  terms  of  time  and  money)  and 


good  estimates  o-f  efficiency  can  support  management  decision 
making.  Lastly,  the  multiple  output  model  (Tests  9  and  10) 
produced  little  information  useful  to  management.  The 
results  show  a  limitation  of  using  DEA  and  CFA  techniques 
for  small  data  sets  because  the  model  had  too  much  freedom 
to  ignore  portions  of  the  data. 

Interviews  with  managers  establishes  that  DEA  and  CFA 
techniques  were  improvements  over  past  measurement  efforts 
and  could  reliably  report  technical  efficiency  in  the 
maintenance  environment.  The  managers  believed  that  the 
results  were  valid  and  could  produce  information  directly 
beneficial  to  their  decision  making.  They  enthusiastically 
suggested  further  DEA/CFA  research  and  planned  to 
investigate  these  techniques  with  other  shop  applications. 

Summary .  The  authors  believe  that  productivity 
measurement  in  depot-level  maintenance  environments  is  a 
valid  problem  because  past  measurement  techniques  were 
insufficient.  DEA  and  CFA  techniques  are  improvements  over 
past  measurement  efforts  and,  if  used  properly,  should  meet 
the  information  needs  of  maintenance  managers  at  any  level. 
They  are  useful  measurement  techniques  for  AFLC  depot-level 
maintenance  because  they  can  produce  information  that  is 
directly  beneficial  to  managerial  decision  making.  A 
DEA/CFA  model  could  be  developed  to  reliably  report 
technical  efficiency  in  any  maintenance  environment  given 
that  close  cooperation  between  the  users  and  model  designers 
is  established.  Lastly,  these  authors  suggest  that 


effectiveness  as  well  as  efficiency  could  be  measured  given 
proper  input/output  selection  and  an  expanded  data  base. 

Recommenda t i ons 

Objective  -five,  <5>  suggestions  -for  -further  research 
and  suggested  Air  Force  DEA  and  CFA  applications,  is  met  in 
this  section  with  the  -following  recommendations: 

1.  HQ  AFLC  should  participate  in  the  input  and  output 
selection  process  research  with  the  University  o-f  Texas. 
Current  studies  at  the  UT  Educational  Productivity  Council 
suggest  that  the  relationships  o-f  the  variables  a-f-fect  the 
quality  o-f  the  analysis.  Statistical  studies,  such  as 
correlations  and  preliminary  CFA  results,  should  be  examined 
for  use  in  the  input  and  output  selection  process. 

2.  HQ  AFLC  needs  to  explore  additional  applications  of  DEA 
and  CFA  in  the  maintenance  environment  by  continuing  the 
hydraulic  shop  analysis  and  analyzing  other  shops  in  SMALC 
and  other  Air  Logistic  Centers.  Also,  DEA/CFA  application 
research  and  test  at  Newark  Air  Logistics  Center  would  seem 
to  be  ideal  because  of  Newark's  small  output  size, 
stability,  actual  accounting  system  and  degree  of 
automation.  HQ  AFLC  managers  are  anxious  to  dedicate 
in-house  resources  if  any  of  the  above  research 
recommendations  are  undertaken. 


3.  A  productivity  research  center  should  be  established  at 
AFIT  to  serve  as  a  -focal  point  for  the  Air  Force 
productivity  research  efforts  much  like  the  Educational 
Productivity  Council  at  the  University  of  Texas  serves  as  a 
focal  point  for  productivity  improvement  efforts  of  over  600 
secondary  schools.  AFIT  should  be  the  focal  point  for  Air 
Force  productivity  research  because  this  type  of  research  is 
consistent  with  AFIT  research  objectives  and  the  faculty 
includes  the  co-inventor  of  CFA  and  other  members  who  are 
currently  researching  the  potential  uses  of  DEA  and  CFA 
anal yses . 

4.  The  Department  of  Defense  needs  to  study  other  DOD 
applications  of  DEA/CFA  analyses.  The  flexibility  of  the 
DEA/CFA  techniques  suggests  endless  possibilities  for 
applications  in  administration,  aircraft  and  ballistic 
missile  operations,  transpor tat i on  and  distribution  fields 
and  logistics  planning. 

An  unprecedented  opportunity  exists  between  HQ  AFLC 
managers,  AFIT  students  and  faculty  advisors  and  the 
University  of  Texas  researchers  to  work  together  on  the 
important  problem  of  productivity  measurement  in  the  Air 
Force.  HQ  AFLC  needs  to  implement  a  productivity  analysis 
system  that  is  academically  valid,  useful  to  all  levels  of 
management  and  supportive  of  the  command's  information 
needs.  AFIT  should  take  advantage  of  this  opportunity  to 


Appendix  A:  Glossary  of  Terms 


All  Other  Dollars  -  An  input  variable  for  DEA  and  CFA 
analyses  derived  by  subtracting  total  labor  dollars  and 
total  material  dollars  from  total  cost  dollars  extracted 
from  the  Form  G035A  (Appendix  B) . 

Constrained  Facet  Analysis  <CFA>  -  An  extension  of  Data 
Envelopment  Analysis  which  analyzes  efficiencies  for  DMUs 
that  are  not  fully  enveloped  and  provides  upper  and  lower 
bound  measures  of  efficiency.  The  actual  efficiency  measure 
is  somewhere  between  the  upper  and  lower  bound. 

Constraint  -  An  equality  or  inequality  that  restricts  or 
limits  the  linear  fractional  programming  objective  function 
to  certain  feasible  solutions. 

Data  Envelopment  Analysis  <DEA>  -  A  linear  fractional 
program  that  evaluates  multiple  inputs  and  outputs 
simultaneously  through  mu  1 t i -d i mens i onal  mathematics  forming 
a  frontier  of  efficiency  and  providing  a  relative  efficiency 
rating  for  each  decision  making  unit. 

Decision  Making  Unit  <DMU)  -  An  organizational  element 
that  is  being  analyzed  such  as  a  warehouse  or  shop. 

Effective  -  Producing  outputs  quantities  with  input 
resources  that  are  of  sufficient  quality  and  consistent  with 
the  quantity  and  timeliness  goals  of  a  person  or  an 
organ i zat i on . 

Efficient  -  Producing  more  outputs  with  the  same  input 
resources  or  producing  the  same  outputs  with  less  input 
resources . 

Efficiency  -  The  ratio  of  outputs  produced  or  work 
completed  divided  by  input  resources  consumed. 

Envelopment  -  A  char ac ter i st i c  of  DEA  analysis  where  the 
efficiency  measure  of  an  inefficient  decision  making  unit  is 
determined  from  comparison  with  a  complete  frontier  facet 
which  is  defined  entirely  by  empirical  observations  so  that 
the  upper  and  lower  bounds  of  efficiency  are  equal. 

Harddisk  -  the  physical  equipment  to  store  programs  and 
procedures  to  aid  the  computer  operation. 


Inflation  Factors  -  Inflation  percentages  from  the  Office 
of  the  Secretary  of  Defense  for  Proposed  Budget  and  Sales 
that  were  used  to  adjust  1982  and  1983  input  variables 
(expressed  as  dollars)  to  1981  dollars. 

Labor  Hours  -  Actual  man  hours  worked  that  were  extracted 
from  Form  G035A  (Appendix  B)  and  used  as  an  input  variable 
for  the  DEA/CFA  analysis. 

Linear  Fractional  Program  -  A  specific  type  of  nonlinear 
program  that  evaluates  a  ratio  of  linear  expressions. 

Linear  Program  -  A  mathematical  problem  which  has  an 
objective  function  and  constraints  where  all  mathematical 
expressions  are  linear. 

Lower  Bound  Efficiency  -  The  lowest  possible  efficiency 
rating  for  a  given  decision  making  unit. 

Model  -  A  mathematical  represen  tat i on  of  a  real  situation. 

Not-For-Profit  Organization  -  An  organization  whose  goal 
is  not  to  make  a  profit  but  to  provide  a  service  such  as  a 
hospital  or  the  Department  of  Defense. 

Objective  Function  -  A  mathematical  expression  that  is 
either  maximized  or  minimized  and  is  limited  by  its  set  of 
constrai nts. 

Observed  Quarter  -  Three  months  of  a  fiscal  year  in  which 
all  inputs  and  outputs  are  summed  and  used  as  variables  for 
the  DEA/CFA  models. 

Output  Quantity  -  The  result  of  multiplying  shop  direct 
activity  hours  times  the  number  of  items  repaired  that  were 
extracted  from  Form  G019C  (Appendix  B>  and  compiled  as 
output  data  (Appendix  C>  for  DEA  and  CFA  analyses. 

Partial  Ratio  -  One  output  amount  divided  by  one  input 
amount  when  multiple  inputs  and  multiple  outputs  are 
present . 

Piece-Wise-Linear  Frontier  -  A  frontier  formed  by  the  most 
efficient  decision  making  units  where  each  facet  of  the 
frontier  is  a  linear  combination  of  efficient  observations. 

Production  Function  -  A  function  that  provides  the 
theoretical  maximum  amount  of  output  obtained  from  the  given 
level  of  inputs  of  a  process. 


Productivity  -  A  function  of  effectiveness  and  efficiency, 
the  ratio  of  outputs  produced  divided  by  the  inputs  consumed 
where  outputs  are  useful  and  consistent  with  the  goals  of  a 
person  or  organization. 

Quality  -  A  standard  by  which  an  item  or  value  is  judged. 

Ratio  -  The  quotient  of  one  number  divided  by  another. 

Software  -  Programs  used  to  simplify  the  use  of  a  computer 
operating  system. 

Technical  Efficiency  -  A  measure  of  a  firms  success  in 
achieving  the  maximum  output  from  inputs  expended  expressed 
as  a  ratio  of  an  observed  level  of  outputs  over  inputs 
divided  by  a  maximum  value  of  outputs  over  inputs  on  the 
piece-wise  linear  frontier. 

Timeliness  -  A  state  of  being  early  or  on  time. 

Total  Factor  Ratio  -  A  ratio  of  all  outputs  over  all 
inputs  in  an  organization. 


Total  Labor  Dollars  -  The  sum  of  direct  labor  dollars  plus 
indirect  labor  dollars  extracted  from  Form  G035A  (Appendix 
B)  and  used  as  an  input  variable  for  the  DEA  and  CFA 
anal yses. 

Total  Material  Dollars  -  The  sum  of  direct  material 
dollars  plus  indirect  material  dollars  extracted  from  Form 
G035A  (Appendix  B>  and  used  as  an  input  variable  for  the  DEA 
and  CFA  analyses. 

Upper  Bound  Efficiency  -  The  highest  possible  efficiency 
rating  for  a  given  decision  making  unit. 


Appendix  B:  Sample  Data  Source 
Input  Data  Source  (Form  S035A) 
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Appendix  C:  Output  Quantity  Data 


1981  Output  Quantities  -for  Each  Quarter  (Qtr) 


AD-A147  229  FEASIBIL ITV  OF  MEASURING  TECHNICAL  PROOUCTIVITV 

IMPROVEMENTS  IN  AIR  FORE  <U)  AIR  FORCE  INST  OF  TECH 
WRIGHT-PATTERSON  AFB  OH  SCHOOL  OF  SVST.  . 

UNCLASSIFIED  R  E  HITT  ET  AL  SEP  84  AFIT/GLM/LSM/84S-30  F/G  12/8 


I* 


1 6500- 
1 6500- 
1 6500- 
1 6500- 
1 6500- 
1 6500- 
16800- 
1 6800- 
41400- 
43200- 
43200- 
43200- 
43200- 
43200- 
43200 
43200 
43200- 
43200 
43200 
43200- 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
43200 
61150 


■10091813  , 
-10255260  , 
-10394977BJ, 
-1 056891  4WF, 
-10414568  , 
-10586259  , 
-04083400  , 
-05400164  , 
-0450621 7BJ, 
-00586925HS, 
-01 62391 7HS, 
-0062051 1HS, 
-01 62391 7HS, 
-021 35986HS , 
-04409598HS, 
-02898605HS, 
-02990378HS , 
-0441 2858HS , 
-0451551 1HS, 
-04864224HS , 
-04864224MN , 
-04891 667GK , 
-04891 667HS, 
-04894688HS , 
-04907424LH , 
-09235642HS, 
-05293359HS , 
-08055504HS , 
-021 35986HS , 
-05551 277HS, 
-02135986HS, 
-0651 7329HS , 
-07020269Y0, 
-07059497HS, 
-07060778HS, 
-07250479HS, 
-07564988HS , 
-07608691 HS , 
-07686345HS , 
-09334698HS , 
-02898605HS , 
-08397642HS , 
-08648677HS , 
-08801 603HS, 
-09235642HS , 
-021 35986HS , 
-021 35986HS , 
-021 35986HS , 
-1 1 21 3632UH . 


.0, 

•  o, 

.0, 

.0, 

•  o, 

.0, 

6 

43.5, 

377.0, 

754.0, 

594 

.0, 

.0, 

.0, 

.0, 

.0, 

800.0, 

800 

•  o, 

.0, 

.0, 

13.2, 

13.2, 

16.5, 

6 

43.0, 

129.0, 

124.7, 

94 

7.7, 

38.5, 

23.1  , 

46 

1140.0, 

1092.0, 

1272.0, 

1092 

162.0, 

121 .5, 

24.3, 

113 

.0, 

.0, 

.0, 

86.0, 

68.8, 

197.8, 

120 

32.5, 

65.0, 

91  .0, 

91 

.0, 

13.2, 

26.4, 

26 

■  o, 

.0, 

.0, 

.0, 

.0, 

.0, 

.0, 

.0, 

.0, 

.0, 

.0, 

.0, 

8.8, 

13.2, 

4.4, 

4.4, 

4.4, 

.0, 

.0, 

•  o, 

.1  , 

258.0, 

309 . 6 , 

430.0, 

430 

91  .0, 

35.0, 

28.0, 

63 

.0, 

.0, 

2.0, 

.0, 

.0, 

.0, 

.0, 

.0, 

14.1  , 

.0, 

•  0, 

.0, 

23 

97.5, 

104.0, 

104.0, 

104 

.0, 

43.0, 

86.0, 

64 

97.5, 

143.0, 

169.0, 

169 

•  o, 

■  o, 

.0, 

.0, 

.0, 

.0, 

.0, 

•  o, 

.0, 

.0, 

■  o, 

.0, 

.0, 

.0, 

.0, 

3 

86.0, 

47.3, 

51  .6, 

60 

40.5, 

16.2, 

.0, 

121 

291 .5, 

323.5, 

275.6, 

270 

18.6, 

12.4, 

18.6, 

.0, 

.0, 

.0, 

.0, 

•  o, 

.0, 

•  o, 

.0, 

.0, 

173.6, 

140.0, 

84.0, 

151 

■  o, 

.0, 

.0, 

.0, 

.0, 

.0, 

•  o, 

.0, 

.0, 

•  0, 

.0, 

.0, 

.0, 

.0, 

.0, 

ocoinooO'O'OwoTfOrrou-ooooooooooooooinooooo^rNinc'jooooNooooo 


tem  Num 


Qtr  7 


Qtr  8 


15500- 
16500- 
16500- 
1 6500- 
1 6500- 
1 6500- 
1 6500- 
1 6500- 
1 6500- 
1 6500- 
16500 
1 6500 
1 6500 
1 6500 
1 6500- 
1 6500 
1 6500 
1 6500 
1 6500 
1 6500 
1 6500 
1 6500 
1 6500 
1 6500 
16500 
1  6500 
16500 
1 6500 
1 6500 
1 6500 
16500 
1 6500 
1 6500 
1 6500 
16500 
1  6500 
16500 
1 6500 
16500 
1  6500 
1 6500 
1  6500 
16500 
1 6500 
16500 
16500 


-00786426BJ 

-006005488J 

-00739158 

■02041703 

-02251 878LH 

-02889632 

-02889632 

■11006019 

-0351 5708GK 

•039350428J 

-04040343BJ 

-04428061 

-04563641LH 

-04770637LH 

-04866297LH 

-04877678LH 

-08159387 

-05800482 

-07838881MN 

-05355878 

-05400162 

-054001 72MN 

-05400204 

-055481 02 

-05800482 

-06911771 

-06846163 

-06911771 

-07201301 

-07282780 

-07667961 

-07878858 

-08159387 

-08243321 

-08252590 

-08473742 

-08889841 

-08933964 

-10091812 

-09374099 

-09491868 

-09541429 

-09930426 

-10091812 

-10091813 

-10255260 


50.6, 

62.7, 

20.8, 
44.1  , 
26.8, 

4.4, 

.0, 

67.5, 

.0, 

.0, 

17.4, 

.0, 

5.8, 

1 1  .6, 

197.6, 
98.0, 
88.0, 

48.4, 
4.4, 

196.0, 
44.1  , 
.0, 

13.8, 

312.7, 

110.0, 

.0, 

.0, 

.0, 

74.2, 

129.8, 

94.4, 
106.2, 

52.8, 

.0, 

171 .6, 

5.9, 

47.4, 
230.0, 

.0, 

16.2, 

.0, 

44.1, 

34.4, 
5.3, 
6.1  , 

.0. 


41  .4, 

39.9, 

.0, 

39.2, 
20.1  , 
8.8, 
.0, 

58.5, 
.0, 
.0, 
.0, 

36.0, 
11  .6, 
.0, 

106.4, 

.0, 

114.4, 
44.0, 

.0, 

205.8, 

53.9, 
.0, 

13.8, 

323.3, 

114.4, 
.0, 
.0, 
.0, 

30.8, 

129.8, 
106.2, 

94.4, 

44.0, 

.0, 

220.0, 
1  1  .8, 

118.5, 
138.0, 

.0, 

48.6, 

.0, 

4.9, 

25.8, 

15.9, 

6.1  , 

.0. 


92.0, 

17.1  , 

.0, 

9.8, 

13.4, 

13.2, 

.0, 

4.5, 
.0, 
.0, 
.0, 

28.8, 

.0, 

.0, 

83.6, 

112.7, 

132.0, 

79.2, 

8.8, 

416.5, 

63.7, 
.0, 
.0, 

434.6, 

123.2, 

.0, 

21  .5, 

.0, 

17.6, 

35.2, 

94.4, 

.0, 

39.6, 

11.6, 

189.2, 

141 .6, 

79.0, 

138.0, 

.0, 

48.6, 

6.5, 

29.4, 

159.1 , 

26.5, 

.0, 

6.3. 


82.8 

22.8 

10.4 

122.5 

33.5 
4.4 

.0 

202.5 
.0 
.0 

81  .2 

93.6 
.0 
.0 

83.6 
9.8 

83.6 
44.0 

.0 

367.5 

63.7 
.0 
.0 

339.2 

44.0 

.0 

.0 

.0 

44.0 

135.7 

94.4 

.0 

39.6 

.0 

132.0 

35.4 
63.2 

138.0 

.0 

108.0 

.0 

.0 

159.1 


o  o  o 


Item  number  Qtr  5 

1 6500-1 0394977B J ,  493.0, 
1 6500-1 056891 4WF ,  .0, 
1 4500-1041 4568  ,  1200.0, 
16500-10586259  ,  .0, 
16800-04083400  ,  16.5, 
1 6800-05400 164  ,  156.8, 
41 400-0450621 7BJ,  15.4, 
43200-00586925HS ,  .0, 
43200-0162391 7HS ,  121.5, 
43200-0062051 1HS,  1164.0, 
43200-01 62391 7HS,  86.0, 
43200-02 1 35986HS ,  65.0, 
43200-04409598HS ,  8.8, 
43200-02898605HS ,  .0, 
43200-02990378HS ,  .0, 
43200-0441 2858HS ,  . 0 , 
43200-045 1 55 1 1 HS ,  72.8, 
43200-04864224HS ,  4.4, 
43200-04864224MN ,  8.8, 
43200-04891 667GK,  .0, 
43200-04891 667HS,  172.0, 
43200-04894688HS ,  140.0, 
43200-04907424LH ,  .0, 
43200-09235642HS ,  .0, 
43200-05293359HS ,  .0, 
43200-08055504HS ,  .0, 
43200-021 35986HS,  65.0, 
43200-0555 1277HS,  55.9, 
43200-02 1 35986HS ,  188.5, 
43200-065 1 7329HS ,  . 0 , 
43200— 07020269Y0 ,  .0, 
43200-07059497HS ,  .0, 
43200-07060778HS ,  .0, 
43200-07250479HS ,  .0, 
43200-07564988HS ,  52.8, 
43200-07608691 HS ,  .0, 
43200-07686345HS ,  174.9, 
43200-09334698HS ,  .0, 
43200-02898605HS ,  .0, 
43200-08397642HS ,  .0, 
43200-08648677HS ,  .0, 
43200-0880 1 603HS ,  89.6, 
43200-09235642HS ,  .0, 
43200-02 1 35986HS ,  188.5, 
43200-021 35986HS,  422.5, 
43200-021 35986HS,  435.0, 
61 150-11 21 3632UH,  .0, 


Qtr  6 

Qtr  7 

Qtr  8 

609 . 0 , 

609 . 0 , 

797.5 

.0, 

.0, 

.0 

800.0, 

800.0, 

.0 

.0, 

40.5, 

40.5 

19.8, 

16.5, 

23.1 

102.9, 

102.9, 

245.0 

.0, 

.0, 

30.8 

.0, 

•  o, 

.0 

170.1, 

251.1, 

162.0 

970.0, 

2240.0, 

1067.0 

206.4, 

103.2, 

129.0 

65.0, 

78.0, 

45.5 

13.2, 

13.2, 

35.2 

.0, 

.0, 

.0 

.0, 

.0, 

.0 

.0, 

.0, 

.0 

27.3, 

54.6, 

81  .9 

•  o, 

.0, 

13.2 

4.4, 

13.2, 

4.4 

.0, 

.0, 

.0 

292.4, 

326.8, 

172.0 

140.0, 

112.0, 

56.0 

.0, 

.0, 

.0 

.0, 

.0, 

.0 

28.8, 

.0, 

.0 

.0, 

9.2, 

.0 

97.5, 

162.5, 

175.5 

73.1  , 

34.4, 

73.1 

195.0, 

253.5, 

136.5 

.0, 

.0, 

.0 

.0, 

.0, 

.0 

.0, 

•  0, 

.0 

.0, 

.0, 

.0 

■  o, 

•  o, 

.0 

61  .6, 

44.0, 

48.4 

64.8, 

243.0, 

81  .0 

227.9, 

296.8, 

318.0 

•  o, 

.0, 

.0 

.0, 

.0, 

.0 

.0, 

•  o, 

.0 

.0, 

•  o, 

.0 

140.0, 

168.0, 

89.6 

.0, 

.0, 

.0 

195.0, 

325.0, 

169.0 

390.0, 

422.5, 

390.0 

748.2, 

626.4, 

513.3 

160.0, 

800 . 0 . 

880.0 

inoon>lo(sooooiflNooos>N^oooooooioxinooooo40ooooo'Oooono 


A/ 


_•  v  >  ".«•  V  / 


1983  Output  Quantities  -for  Each  quarter  <qtr> 


Item  Number 


1 5500-00786426B J , 
1  6500-00600548B J , 
16500-00739158  , 
16500-02041703  , 
1 6500-0225 1878LH, 
16500-02889632  , 
16500-02889632  , 
16500-1 1006019  , 
1 6500-0351 5708GK, 
1 6500-03935042B J , 
1 6500-040403438 J, 
16500-04428061  , 
1 6500-04563641 LH, 
1 6500-04770637LH , 
1 6500-04866297LH , 
1  6500-04877678LH , 
16500-08159387  , 
1 6500-05800482  , 
1 6500-0783888 1MN, 
16500-05355878  , 
16500-05400162  , 
1  6500-054001 72MN, 
16500-05400204  , 
16500-05548102  , 
1 6500-05800482  , 
16500-0691 1771  , 
16500-06846163  , 
16500-06911771  , 
16500-07201301  , 
1 6500-07282780  , 
16500-07667961  , 
16500-07878858  , 
16500-08159387  f 
16500-08243321  , 
16500-08252590  , 
1 6500-08473742  , 
16500-08889841  , 
16500-08933964  , 
16500-10091812  , 
16500-09374099  , 
16500-09491868  , 
16500-09541429  , 
16500-09930426  , 
16500-10091812  , 
16500-10091813  , 
16500-10255260  , 
1 6500-1 0394977BJ, 


Qtr  9 

Qtr  10 

Qtr  1  1 

Qtr 

27.6, 

124.2, 

161.0, 

138 

.0, 

11.4, 

28.5, 

28 

.0, 

62.4, 

83.2, 

40 

39.2, 

53.9, 

58.8, 

73 

33.5, 

40.2, 

40.2, 

20 

13.2, 

•  o, 

17.6, 

3 

.0, 

8.8, 

8.8, 

8 

w 

Ch 

• 

o 

67.5, 

54.0, 

45 

.0, 

.0, 

.0, 

.0, 

85.8, 

14.3, 

14 

92.8, 

127.6, 

220 . 4 , 

110 

36.0, 

57.6, 

36.0, 

14 

5.8, 

.0, 

.0, 

.0, 

5.8, 

•  o, 

136.8, 

144.4, 

76.0, 

45 

137.2, 

98.0, 

122.5, 

151 

61  .6, 

140.8, 

74.8, 

88 

44.0, 

48.4, 

57.2, 

.0, 

26.4, 

13.2, 

171.5, 

303.8, 

328 . 3 , 

264 

29.4  j 

29. 4  j 

9.8, 

.0, 

•  o, 

•  o, 

.0, 

23.0, 

9.2, 

9 

439.9, 

731.4, 

159.0, 

238 

52.8, 

35.2, 

26.2, 

.0, 

.0, 

•  o, 

.0, 

.0, 

26.4, 

30 

.0, 

.0, 

.0, 

22.0, 

35.2, 

39.6, 

44 

59.0, 

94.4, 

35.4, 

82 

94.4, 

94.4, 

88.5, 

88 

.0, 

47.2, 

59.0, 

53 

26.4, 

79.2, 

35.2, 

96 

.0, 

.0, 

.0, 

5 

154.0, 

206.8, 

162.8, 

149 

88.5, 

29.5, 

23.6, 

23 

118.5, 

134.3, 

94.8, 

158 

172.5, 

207.0, 

23.0, 

.0, 

.0, 

.0, 

43.2, 

37.8, 

32.4, 

64 

6.5, 

6.5, 

.0, 

.0, 

9.8, 

19.6, 

93 

120.4, 

137.6, 

68.8, 

129 

90.1  , 

10.6, 

10.6, 

10 

.0, 

•  o, 

6.1  , 

.0, 

6.3, 

6.3, 

681 .5, 

739.5, 

768.5, 

551 

<acooonNvoO'«(scooo'OooNinoooooo'Oin-cocO'0'Oooo()i)o-0'Oooo 


tr  9  Qtr  10  Qtr  11  Qtr  12 


16500-1 056891 4WF, 

.0, 

00 

on 

• 

0^ 

16500-10414568  , 

.0, 

.0, 

16500-10586259  , 

40.5, 

.0, 

16800-04083400  , 

13.2, 

.0, 

16800-05400164  , 

196.0, 

176.0, 

41 400-0450621 7BJ, 

61  .6, 

38.5, 

43200-00586925HS , 

.0, 

.0, 

43200-01 6239 17HS, 

97.2, 

16.2, 

43200-0062051 1HS, 

1018.5, 

717.8, 

43200-01 62391 7HS, 

43.0, 

111.8, 

43200-021 35986HS, 

84.5, 

890.5, 

43200-04409598HS , 

.0, 

.0, 

43200-02898605HS , 

.0, 

65.0, 

43200-02990378HS , 

144.0, 

144.0, 

43200-044 12858HS, 

.0, 

.0, 

43200-0451551 1HS, 

9.1  , 

9.1  , 

43200-04864224HS , 

.0, 

8.8, 

43200-04864224W , 

.0, 

4.4, 

43200-04891 667GK, 

.0, 

.0, 

43200-04891 667HS, 

129.0, 

60.2, 

43200-04894688HS , 

35.0, 

140.0, 

43200-04907424LH , 

2.0, 

.0, 

43200-09235642HS , 

.0, 

.0, 

43200-05293359HS , 

.0, 

.0, 

43200-08055504HS , 

.0, 

.0, 

43200-02 135986HS, 

19.5, 

6.5, 

43200-05551 277HS, 

12.9, 

73.1  , 

43200-021 35986HS, 

201 .5, 

52.0, 

43200-0651 7329HS, 

.0, 

.0, 

43200-07020269Y0 , 

461 .5, 

475.7, 

43200-07059497HS , 

65.0, 

91.0, 

43200-07060778HS , 

52.0, 

26.0, 

43200-07250479HS , 

.0, 

.0, 

43200-07564988HS, 

88.0, 

22.0, 

43200-07608691 HS , 

32.4, 

81  .0, 

43200-07686345HS , 

291 .5, 

455.8, 

43200-09334698HS , 

.0, 

.0, 

43200-02898605HS , 

.0, 

84.5, 

43200-08397642HS, 

56.0, 

19.6, 

43200-08648677HS , 

15.0, 

15.0, 

43200-08801 603HS, 

123.2, 

84.0, 

43200-09235642HS , 

52.0, 

45.5, 

43200-021 35986HS, 

266.5, 

455.0, 

43200-02 135986HS, 

260.0, 

130.0, 

43200-021 35986HS, 

52.2, 

.0. 

61 150-11 21 3632UH, 

624.0, 

1056.0, 

96 . 3 , 

.0, 

81  .0, 
.0, 
196.0, 
7.7, 
.0, 

40.5, 
1018.5, 

163.4, 
780.0, 

.0, 

•0, 

156.0, 

.0, 

54.6, 
•0, 
•  0, 
.0, 

258.0, 

49.0, 

.0, 

.0, 

.0, 

■0, 

.0, 

47.3, 
.0, 
.0, 

35.5, 
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